Downloads · 30 days
413
20% of all-time downloads
turboderp/gemma-4-31b-it-exl3
gemma-4-31b-it-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
413
20% of all-time downloads
All-time downloads
2.1K
Public
Repo size
250 GB
Likes
28
Public
Click a slice to open those files.
.md1.8 KB · 55%
From the Hugging Face model README
EXL3 quants of gemma-4-31B-it
mul1 quants (recommended, improved performance on exllamav3>=v1.0.0):
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
6.00 bits per weight
MCG quants (legacy):
2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
