Downloads · 30 days
6
11% of all-time downloads
llmixer/Midnight-Rose-103B-v2.0.3-3.5bpw-h6-exl2
Midnight-Rose-103B-v2.0.3-3.5bpw-h6-exl2 is a text generation model from llmixer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Exllamav2 3.5bpw h6 quant for Midnight-Rose-103B-v2.0.3.
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
53
Public
Repo size
45.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors45.7 GB · 100%
From the Hugging Face model README
Exllamav2 3.5bpw h6 quant for Midnight-Rose-103B-v2.0.3.
Default calibration dataset.