Downloads · 30 days
98
14% of all-time downloads
turboderp/Mistral-7B-instruct-v0.3-exl2
Mistral-7B-instruct-v0.3-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
98
14% of all-time downloads
All-time downloads
679
Public
Repo size
24.3 GB
Likes
2
Public
Click a slice to open those files.
.json1.8 MB · 100%
From the Hugging Face model README
EXL2 quants of Mistral-7B-instruct-v0.3
v0.3's vocabulary is compatible with Mistral-Large-123B, so this works as a draft model for Mistral-Large.
2.80 bits per weight
3.00 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight