Downloads · 30 days
115
69% of all-time downloads
turboderp/Mistral-Small-4-119B-2603-exl3
Mistral-Small-4-119B-2603-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXL3 quants of mistralai/Mistral-Small-4-119B-2603
Downloads · 30 days
115
69% of all-time downloads
All-time downloads
167
Public
Repo size
142 GB
Likes
2
Public
Click a slice to open those files.
Other1.5 KB · 59%
From the Hugging Face model README
EXL3 quants of mistralai/Mistral-Small-4-119B-2603
⚠️ Needs ExLlamav3 v1.4.1 (or dev branch)
2.03 bits per weight
3.03 bits per weight
4.03 bits per weight

(Could not find any working GGUF quants to compare, sorry.)