Downloads · 30 days
290
12% of all-time downloads
g0chu/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant-q8_0-gguf
gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant-q8_0-gguf is a machine learning model from g0chu. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Use as draft model for gemma-4-26B-A4B-it-qat in llama.cpp.
Downloads · 30 days
290
12% of all-time downloads
All-time downloads
2.5K
Public
Repo size
462 MB
Likes
2
Public
Click a slice to open those files.
.gguf462 MB · 100%
From the Hugging Face model README
Use as draft model for gemma-4-26B-A4B-it-qat in llama.cpp.
Tested with:
/home/gochu/workspace/repos/llama.cpp-gemma4-mtp/build/bin/llama-server \
-m /home/gochu/workspace/models/gguf/gemma/qat/gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf \
-md /home/gochu/workspace/models/gguf/gemma/draft/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant-q8_0.gguf \
--spec-type draft-mtp \
--spec-draft-n-max 3 \
--host 0.0.0.0 \
--port 8080 \
-c 128000 \
-ngl 99 \
-b 2048 \
-ub 512 \
-fa on \
-np 1 \
-sm tensor \
--jinja \
--chat-template-kwargs '{"enable_thinking":true}' \
--no-mmproj-offload \
--mmproj /home/gochu/workspace/models/gguf/gemma/mmproj/gemma-4-26B-it-mmproj.gguf