Downloads · 30 days
394
21% of all-time downloads
RemySkye/Gemma-4-E2B-it-qat-abliterated-UD-Q4_K_XL-GGUF
Gemma-4-E2B-it-qat-abliterated-UD-Q4_K_XL-GGUF is a machine learning model from RemySkye. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
394
21% of all-time downloads
All-time downloads
1.9K
Public
Repo size
3.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf3.6 GB · 100%
From the Hugging Face model README
Source:
huihui-ai/Huihui-gemma-4-E2B-it-qat-q4_0-unquantized-abliterated
Huihui-gemma-4-E2B-it-qat-UD-Q4_K_XL-like.gguf — main modelmmproj-BF16.gguf — BF16 multimodal projectorimatrix_unsloth.gguf_file — exact Unsloth importance matrix usedquantization_manifest.json — hashes and provenancefc6545d322a9ea6643f77439b31b66f403ba2cadQ4_0--pure: enabledunsloth/gemma-4-E2B-it-GGUF/imatrix_unsloth.gguf_fileunsloth/gemma-4-E2B-it-qat-GGUF/mmproj-BF16.ggufThis is a publicly reproducible Unsloth-like QAT conversion, not the
official Unsloth UD-Q4_K_XL algorithm.
Unsloth's official Gemma 4 QAT GGUFs use additional scale/lattice recovery
logic when mapping the BF16 QAT lattice into llama.cpp's Q4_0 representation.
That exact recovery procedure is not exposed as a standard public
llama-quantize option.
llama-server \
-m Huihui-gemma-4-E2B-it-qat-UD-Q4_K_XL-like.gguf \
--mmproj mmproj-BF16.gguf \
--jinja \
-ngl 999