Downloads · 30 days
139
29% of all-time downloads
Grunzig/gemma-4-E4B-it-qat-oQ4e-fp16-mtp
gemma-4-E4B-it-qat-oQ4e-fp16-mtp is a machine learning model from Grunzig. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx.
This model was quantized using oQ (oMLX v0.6.3rc1) mixed-precision quantization. google/gemma-4-E4B-it-qat-q40-unquantized-assistant MTP head was merged into google/gemma-4-E4B-it-qat-q40-unquantized. It is optimized…
Downloads · 30 days
139
29% of all-time downloads
All-time downloads
485
Public
Parameters
8B
6.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.4 GB · 99%
How the weights are stored.
U327.5B · 93%
From the Hugging Face model README
This model was quantized using oQ (oMLX v0.6.3rc1) mixed-precision quantization.
google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant MTP head was merged into google/gemma-4-E4B-it-qat-q4_0-unquantized.
It is optimized for Mac M1/M2 (fp16).