Downloads · 30 days
143
38% of all-time downloads
turboderp/gemma4-31b-it-DFlash-exl3
gemma4-31b-it-DFlash-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
143
38% of all-time downloads
All-time downloads
374
Public
Repo size
4.6 GB
Likes
7
Public
Click a slice to open those files.
Other1.5 KB · 57%
From the Hugging Face model README
EXL3 quants of gemma-4-31B-it-DFlash
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
| Quant | Mean acc. tokens¹ |
|---|---|
| 2.50 bpw | 4.00 |
| 3.00 bpw | 4.07 |
| 3.50 bpw | 4.08 |
| 4.00 bpw | 4.10 |
| 5.00 bpw | 4.12 |
| 6.00 bpw | 4.10 |
| BF16 | 4.07 |
¹ Mean verified tokens per 15-token draft, CatBench at temp=0, using 4.00bpw target model on current exllamav3 dev branch (upcoming v0.0.33)