gemma-4-E4B-it-abliterated

gemma-4-E4B-it-abliterated

Uncensored version of google/gemma-4-E4B-it with refusal behavior removed via arbitrary rank ablation (ARA).

Blog post: Abliteration part 2: Beating Google's guardrails (Gemma 4)

Method

ARA is a direct weight-editing method that solves a local optimization problem at each steerable matrix instead of projecting out a single global refusal direction.

Why ARA and not direction abliteration

Gemma 4 E4B uses an additional set of architectural defenses: four RMSNorm layers per decoder block, per-layer embeddings, and shared keys and values. These break the single-direction assumption of direction abliteration. Direction abliteration stopped at approximately 30 percent refusals inside the divergence budget. ARA reaches 2.7 percent refusals on the same evaluation set. This is the best documented abliteration result for Gemma 4 E4B with full methodology disclosure.

Fewer defenses does not mean easier: the standard Gemma 4 models (26B-A4B and 31B) drop per-layer embeddings and shared K/V, but add expert routing or extra capacity that makes them harder abliteration targets in practice.

Evaluation

Original model refusal rate on the same prompts: 98 percent.

Usage

from transformers import AutoModelForImageTextToText, AutoTokenizer
import torch

model_id = "Bahushruth/gemma-4-E4B-it-abliterated"
model = AutoModelForImageTextToText.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(model_id)

messages = [{"role": "user", "content": "Your prompt here"}]
text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
inputs = tokenizer(text, return_tensors="pt").to(model.device)

with torch.no_grad():
    output = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

Architecture Notes

Gemma 4 E4B is a multimodal (text + vision + audio) model with approximately 8B parameters.

• Layers: 42
• Hidden size: 2560
• Attention heads: 8, KV heads: 2
• Defenses: four RMSNorm layers per block, per-layer embeddings (256 dimensions), 18 shared K/V layers
• Sliding window attention: alternates with full attention

Related Models

• Bahushruth/gemma-4-E2B-it-abliterated
• Bahushruth/gemma-4-26B-A4B-it-abliterated
• Bahushruth/gemma-4-31B-it-abliterated

Disclaimer

This model has had safety guardrails removed. It will comply with requests that the original model would refuse. The creator takes no responsibility for how this model is used. It is released for research purposes to study AI alignment and safety mechanisms.

Citation

@misc{bahushruth2026gemma4e4b,
  title={gemma-4-E4B-it-abliterated: Arbitrary Rank Ablation on Gemma 4},
  author={Bahushruth},
  year={2026},
  url={https://huggingface.co/Bahushruth/gemma-4-E4B-it-abliterated}
}

Acknowledgments

• p-e-w/heretic for arbitrary rank ablation (ARA)
• grimjim for norm-preserving weight editing
• mlabonne for the harmless dataset and abliteration technique
• Google for the Gemma 4 family