Downloads · 30 days
49
19% of all-time downloads
chibifire/gemma-4-12B-it-qat-q4_0-gguf
gemma-4-12B-it-qat-q4_0-gguf is a machine learning model from chibifire. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Gemma 4 12B instruction-tuned model, trained with Q40 quantization-aware training (QAT), mirrored as a Q40 GGUF file.
Downloads · 30 days
49
19% of all-time downloads
All-time downloads
261
Public
Repo size
7 GB
Likes
0
Public
Click a slice to open those files.
.gguf7 GB · 100%
From the Hugging Face model README
Gemma 4 12B instruction-tuned model, trained with Q4_0 quantization-aware training (QAT), mirrored as a Q4_0 GGUF file.
This repo is a mirror of Google DeepMind's Gemma 4 12B instruction-tuned QAT Q4_0 checkpoint. QAT trains the model to keep its quality when its weights are stored at Q4_0 precision. It holds one Q4_0 GGUF file with the weights. Use it as a pinned copy of the upstream weights for local inference and for further conversion.
Load the file with llama.cpp or another GGUF runtime.
hf download chibifire/gemma-4-12B-it-qat-q4_0-gguf --local-dir gemma-4-12B-it-qat-q4_0-gguf
For prompts, chat template, thinking modes and multimodal input, read the upstream model card and the Gemma documentation.
Apache 2.0, under the Gemma 4 licence terms at https://ai.google.dev/gemma/docs/gemma_4_license. These terms travel with the weights. Keep this link when you copy or redistribute them.