Downloads · 30 days
39
34% of all-time downloads
InterstellarCG/gemma-4-E2B-it-Q4_0-lean-GGUF
gemma-4-E2B-it-Q4_0-lean-GGUF is a machine learning model from InterstellarCG. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
Requant of gemma-4-E2B-it with every large tensor forced to Q40, including the tied token embedding / output head and the per-layer embedding table (the standard Q40 recipe leaves those at Q6K, costing ~20% generation…
Downloads · 30 days
39
34% of all-time downloads
All-time downloads
114
Public
Repo size
2.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf2.7 GB · 100%
From the Hugging Face model README
Requant of gemma-4-E2B-it with every large tensor forced to Q4_0, including the tied token embedding / output head and the per-layer embedding table (the standard Q4_0 recipe leaves those at Q6_K, costing ~20% generation speed on memory-bandwidth-limited hardware).
llama-quantize --allow-requantize --token-embedding-type q4_0 --output-tensor-type q4_0 from the official lmstudio-community Q4_K_M.