Downloads · 30 days
304
29% of all-time downloads
lucifer053/gemma-4-12b-it-uncensored-th-gguf
gemma-4-12b-it-uncensored-th-gguf is a image-text-to-text model from lucifer053. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
An abliterated (refusal-direction-removed) derivative of google/gemma-4-12B-it, with vision and Thai fluency.
Downloads · 30 days
304
29% of all-time downloads
All-time downloads
1K
Public
Repo size
68 GB
Likes
1
Public
Click a slice to open those files.
.gguf20.2 GB · 100%
From the Hugging Face model README
An abliterated (refusal-direction-removed) derivative of google/gemma-4-12B-it, with vision and Thai fluency.
This is a modified model derivative created under the Gemma Terms of Use.
Most abliterated models are measured with English-only refusal datasets, which degrades output quality in other languages. This model was abliterated using a Thai + English parallel prompt dataset, so it stays fluent in Thai while removing over-refusals. Vision is fully preserved — abliteration only touches the text side of the model.
| File | Size | Use case |
|---|---|---|
gemma-4-12B-it-uncensored-beta1-Q4_K_M.gguf | ~6.9 GB | Main LLM, general use |
gemma-4-12B-it-uncensored-beta1-F16.gguf | ~22.2 GB | Main LLM, full precision |
gemma-4-12B-it-uncensored-beta1-mmproj-f16.gguf | ~167 MB | Vision projector (load with the LLM for image/audio input) |
llama-cli -m gemma-4-12B-it-uncensored-beta1-Q4_K_M.gguf -ngl 99 --temp 0.6 --repeat-penalty 1.3 --repeat-last-n 512
Do not drop the temperature below ~0.6 (abliterated models loop at low temp).
Gemma 4 needs --jinja for its chat template, and a large batch size so the
image tokens fit in one non-causal pass:
llama-mtmd-cli -m gemma-4-12B-it-uncensored-beta1-Q4_K_M.gguf --mmproj gemma-4-12B-it-uncensored-beta1-mmproj-f16.gguf --image image.jpg -p "Describe this image" -ngl 99 --temp 0.6 --repeat-penalty 1.3 --jinja -b 4096 -ub 4096
The mmproj also supports audio input (experimental) via --audio.
Place the mmproj file in the same folder as the LLM; it is detected automatically and an image-attach button appears in chat.
Use is subject to the Gemma Terms of Use. Removing refusals does not remove your responsibility — the prohibited-use policy still applies. Do not use this model for illegal or harmful activity.