Downloads · 30 days
79
1% of all-time downloads
sophosympatheia/Midnight-Miqu-103B-v1.0
Midnight-Miqu-103B-v1.0 is a text generation model from sophosympatheia. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
<div style="width: auto; margin-left: auto; margin-right: auto" <img src="https://i.imgur.com/Tn9MBg6.png" alt="MidnightMiqu" style="width: 100%; min-width: 400px; display: block; margin: auto;" </div
Downloads · 30 days
79
1% of all-time downloads
All-time downloads
6.4K
Public
Parameters
103B
206 GB on disk
Likes
17
Public
Click a slice to open those files.
.safetensors206 GB · 100%
From the Hugging Face model README
This is a 103B frankenmerge of sophosympatheia/Midnight-Miqu-70B-v1.0 with itself. Please see that model card for details and usage instructions. This model is based on Miqu so it's capable of 32K context.
If you feel like saying thanks with a donation, <a href="https://ko-fi.com/sophosympatheia">I'm on Ko-Fi</a>
<font color="red">152334H/miqu-1-70b-sf was based on a leaked version of one of Mistral's models.</font> All miqu-derived models, including this merge, are only suitable for personal use. Mistral has been cool about it so far, but you should be aware that by downloading this merge you are assuming whatever legal risk is iherent in acquiring and using a model based on leaked weights. This merge comes with no warranties or guarantees of any kind, but you probably already knew that. I am not a lawyer and I do not profess to know what we have gotten ourselves into here. You should consult with a lawyer before using any Hugging Face model beyond private use... but definitely don't use this one for that!
This model was merged using the passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: /home/llm/mergequant/models/midnight-miqu-70b
layer_range: [0, 40] # 40
- sources:
- model: /home/llm/mergequant/models/midnight-miqu-70b
layer_range: [20, 60] # 40
- sources:
- model: /home/llm/mergequant/models/midnight-miqu-70b
layer_range: [40, 80] # 40
merge_method: passthrough
dtype: float16