Downloads · 30 days
10
1% of all-time downloads
MarsupialAI/Monstral-123B_4.0bpw_EXL2
Monstral-123B_4.0bpw_EXL2 is a text generation model from MarsupialAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
4bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B
Downloads · 30 days
10
1% of all-time downloads
All-time downloads
949
Public
Repo size
62 GB
Likes
1
Public
Click a slice to open those files.
.safetensors62 GB · 100%
From the Hugging Face model README
4bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B
Default settings and dataset utilized for measurements.