Downloads · 30 days
740
12% of all-time downloads
prithivMLmods/gemma-4-E4B-it-qat-heretic_decensored-GGUF
gemma-4-E4B-it-qat-heretic_decensored-GGUF is a image-text-to-text model from prithivMLmods. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
gemma-4-E4B-it-qat-hereticdecensored is a reasoning-capable language model built on top of google/gemma-4-E4B-it-qat-q40-unquantized and modified using the Heretic abliteration toolkit. The model applies refusal-direc…
Downloads · 30 days
740
12% of all-time downloads
All-time downloads
6.3K
Public
Repo size
97 GB
Likes
2
Public
Click a slice to open those files.
.gguf98 GB · 100%
From the Hugging Face model README
gemma-4-E4B-it-qat-heretic_decensored is a reasoning-capable language model built on top of google/gemma-4-E4B-it-qat-q4_0-unquantized and modified using the Heretic abliteration toolkit. The model applies refusal-direction analysis and targeted weight-space interventions to reduce internal refusal behaviors while preserving instruction-following, reasoning capabilities, and general conversational performance.
[!IMPORTANT] This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.
[!NOTE] This model is experimental and may generate unexpected behaviors or artifacts in certain scenarios.
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| gemma-4-E4B-it-qat-heretic_decensored.BF16.gguf | BF16 | 14.9 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.F16.gguf | F16 | 14.9 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q2_K.gguf | Q2_K | 4.38 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q3_K_L.gguf | Q3_K_L | 4.99 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q3_K_M.gguf | Q3_K_M | 4.82 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q3_K_S.gguf | Q3_K_S | 4.63 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q4_0.gguf | Q4_0 | 5.15 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q4_K_M.gguf | Q4_K_M | 5.3 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q4_K_S.gguf | Q4_K_S | 5.17 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q5_0.gguf | Q5_0 | 5.65 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q5_K_M.gguf | Q5_K_M | 5.72 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q5_K_S.gguf | Q5_K_S | 5.65 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q6_K.gguf | Q6_K | 6.17 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.Q8_0.gguf | Q8_0 | 7.95 GB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.mmproj-bf16.gguf | mmproj-bf16 | 992 MB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.mmproj-f16.gguf | mmproj-f16 | 992 MB | Download |
| gemma-4-E4B-it-qat-heretic_decensored.mmproj-q8_0.gguf | mmproj-q8_0 | 560 MB | Download |
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp