gemma-4-26B-A4B-it-heretic

WaveCut/gemma-4-26B-A4B-it-heretic

gemma-4-26B-A4B-it-heretic is a image-text-to-text model from WaveCut. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

Public mirror of the BF16 Heretic checkpoint originally released as coder3101/gemma-4-26B-A4B-it-heretic at commit e6d09d5c434a5e91326ce9d779786a91e7aaae35.

Downloads · 30 days

15% of all-time downloads

All-time downloads

142

Public

Parameters

25.8B

51.6 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors51.6 GB · 100%

At a glance

Task: Image-Text-to-Text
Library: transformers
License: apache-2.0
Model type: gemma4
Access: Public
Created: Jul 15, 2026
Updated: Jul 15, 2026
SHA: 0b1d73c7

Try a prompt

Base models

google/gemma-4-26B-A4B-it

Model card

From the Hugging Face model README

Gemma 4 26B A4B IT Heretic

Public mirror of the BF16 Heretic checkpoint originally released as coder3101/gemma-4-26B-A4B-it-heretic at commit e6d09d5c434a5e91326ce9d779786a91e7aaae35.

Post-process metadata

The checkpoint was produced from google/gemma-4-26B-A4B-it with Heretic 1.2.0 using Arbitrary-Rank Ablation with row-norm preservation.

Parameter	Value
`start_layer_index`	10
`end_layer_index`	30
`preserve_good_behavior_weight`	0.5480
`steer_bad_behavior_weight`	0.0009
`overcorrect_relative_weight`	0.5868
`neighbor_count`	14

Reported by the original post-process run:

Metric	Heretic	Google source
KL divergence	0.0499	0
Refusals	11/100	100/100

2026-07-16 metadata refresh

Google's current source revision is 01e5b3ee840d3a9e0b0b493c593e85398a30ef75. Its two BF16 weight shards have the same LFS SHA256 values as the initial release revision 47b6801b24d15ff9bcd8c96dfaea0be9ed3a0301:

1127684971bbca40465435a5cad69d67ad603bf5e61c6dfd5561fae4a3bcfdb3
aab47033e1e8a492ef8e581efae1cf36478d0433567e7729b3c1728bc8970db7

Because the source weights did not change, rerunning Heretic would transform the same tensors. This mirror keeps the already verified Heretic weights and refreshes the chat template, tokenizer metadata, and processor metadata from Google's current revision. The refresh includes fixes for tool-call turns, thinking history, null arguments, and multimodal tool responses.

Loading

from transformers import AutoModelForMultimodalLM, AutoProcessor

model_id = "WaveCut/gemma-4-26B-A4B-it-heretic"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForMultimodalLM.from_pretrained(
    model_id,
    dtype="auto",
    device_map="auto",
)

This is a third-party post-processed checkpoint. It is not affiliated with or endorsed by Google. Review the Apache 2.0 license and Gemma license link above before redistribution or deployment.

Task: Image-Text-to-Text
Library: transformers
Type: gemma4
License: apache-2.0
Created: Jul 15, 2026
Updated: Jul 15, 2026