Downloads · 30 days
5
4% of all-time downloads
Nimbz/knifeayumu_Cydonia-v4.1-MS3.2-Magnum-Diamond-24B_6.66bpw_H8_EXL3
knifeayumu_Cydonia-v4.1-MS3.2-Magnum-Diamond-24B_6.66bpw_H8_EXL3 is a text generation model from Nimbz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
EXL3 6.66bpw H8 quant, tested using it with 24k q8 context within 24GB VRAM.
Downloads · 30 days
5
4% of all-time downloads
All-time downloads
118
Public
Parameters
10.3B
20.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors20.5 GB · 100%
How the weights are stored.
I169.6B · 93%
From the Hugging Face model README
EXL3 6.66bpw H8 quant, tested using it with 24k q8 context within 24GB VRAM.
Original: https://huggingface.co/knifeayumu/Cydonia-v4.1-MS3.2-Magnum-Diamond-24B

Recipe based on knifeayumu/Cydonia-v1.2-Magnum-v4-22B. Just an update to those who are interested.
Wan-AI/Wan2.2-I2V-A14B was used to turn this image from the previous merge (slightly cropped) to an animation utilising lightx2v/Wan2.2-Lightning for faster generation and pollockjj/ComfyUI-MultiGPU nodes.

This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: TheDrummer/Cydonia-24B-v4.1
- model: Doctor-Shotgun/MS3.2-24B-Magnum-Diamond
merge_method: slerp
base_model: TheDrummer/Cydonia-24B-v4.1
parameters:
t: [0.1, 0.3, 0.6, 0.3, 0.1]
dtype: bfloat16