Downloads · 30 days
97
7% of all-time downloads
Huihui-gemma-4-12B-coder-GGUF
KakoRel/Huihui-gemma-4-12B-coder-GGUF
Huihui-gemma-4-12B-coder-GGUF is a machine learning model from KakoRel. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as gemma.
This repository contains GGUF format quantizations of the huihui-ai/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated model.
All-time downloads
1.5K
Public
Repo size
39.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf39.8 GB · 100%
At a glance
- Library
- gguf
- License
- gemma
- Access
- Public
- Created
- Jun 21, 2026
- Updated
- Jun 21, 2026
- SHA
- 4f110ea8
Base models
Model card
From the Hugging Face model README
Huihui Gemma 4 12B Coder — GGUF Quantizations
This repository contains GGUF format quantizations of the huihui-ai/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated model.
Available Files:
Huihui-gemma-4-12B-coder.f16.gguf— Original unquantized model weights (FP16).Huihui-gemma-4-12B-coder.Q5_K_M.gguf— High quality 5-bit quantization (Recommended balance of speed and quality).Huihui-gemma-4-12B-coder.Q4_K_M.gguf— Medium quality 4-bit quantization (Fastest, perfectly fits 8GB VRAM).
- Library
- gguf
- License
- gemma
- Languages
- en, ru
- Created
- Jun 21, 2026
- Updated
- Jun 21, 2026