Downloads · 30 days
197
18% of all-time downloads
Carlosian/Gemma-4-12b-it-Abliterated-GGUF
Gemma-4-12b-it-Abliterated-GGUF is a text generation model from Carlosian. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
Quantized GGUF builds of Carlosian/Gemma-4-12b-it-Abliterated for llama.cpp / Ollama / LM Studio.
Downloads · 30 days
197
18% of all-time downloads
All-time downloads
1.1K
Public
Repo size
101 GB
Likes
0
Public
Click a slice to open those files.
.gguf101 GB · 100%
From the Hugging Face model README
Quantized GGUF builds of Carlosian/Gemma-4-12b-it-Abliterated for llama.cpp / Ollama / LM Studio.
| Quant | Typical use |
|---|---|
| Q2_K | smallest / extreme low VRAM |
| Q3_K_S / Q3_K_M | low VRAM |
| Q4_0 / Q4_K_S / Q4_K_M | recommended default (Q4_K_M) |
| Q5_K_S / Q5_K_M | higher quality |
| Q6_K | near-lossless |
| Q8_0 | highest quality quant |
| F16 | full intermediate (large) |
Built with llama.cpp on Thunder Compute (A100). Generated 2026-07-20.
The refusal-removal method used to build the base checkpoint draws on: