Downloads · 30 days
8
7% of all-time downloads
isogen/gemma-3-4b-it-exl3-8bpw-h8
gemma-3-4b-it-exl3-8bpw-h8 is a machine learning model from isogen. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
EXL3 quantization of gemma-3-4b-it, 8 bits per weight, including output layers.
Downloads · 30 days
8
7% of all-time downloads
All-time downloads
111
Public
Parameters
3B
6.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.1 GB · 99%
How the weights are stored.
I161.9B · 64%
From the Hugging Face model README
EXL3 quantization of gemma-3-4b-it, 8 bits per weight, including output layers.
| Model | Q4 | Q6 | Q8 | FP16 |
|---|---|---|---|---|
| gemma-3-4b-it-exl3-8bpw-h8 | 72.0 | 73.2 | 71.3 | 70.1 |