gemma-4-26B-A4B-Heretic-Stable-GGUF

gemma-4-26B-A4B-Heretic-Stable-GGUF

gemma-4-26B-A4B-Heretic-Stable is an abliterated evolution built on top of google/gemma-4-26B-A4B-it. This model applies advanced refusal direction analysis and abliteration-based training strategies to significantly reduce internal refusal behaviors while preserving the reasoning and instruction-following strengths of the original architecture. The result is a powerful 26B parameter language model optimized for detailed responses and improved instruction adherence.

[!IMPORTANT] This model is materialized for research and learning purposes only. The model has reduced internal refusal behaviors, and any content generated by it is used at the user’s own risk. The authors and hosting page disclaim any liability for content generated by this model. Users are responsible for ensuring that the model is used in a safe, ethical, and lawful manner.

Evaluation [Self Reported]

Note: This model was tested on 500 randomly sampled harmful prompts based on the harm_bench dataset. The result shows 0 refusals out of 500. For more details, refer to the dataset page linked above.

Model Files

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):