Qwen2.5-VL-7B-Instruct-Ablit

Qwen2.5-VL-7B-Instruct-Ablit (Abliterated Qwen-Image-2512 Text-Encoder)

<table border="0"> <tr> <td width="120"> <img src="comfyui-logo.png" alt="ComfyUI" width="100"/> </td> <td>

Abliterated Qwen2.5-VL-7B-Instruct — full-precision BF16 safetensors. This is a vision-language model with refusal directions removed, enabling uncensored text generation while preserving multimodal capabilities.

Image Generation Use Case: Qwen2.5-VL-7B-Instruct is the text encoder for Qwen-Image-2512. This abliterated version provides a drop-in replacement for uncensored image generation workflows in ComfyUI and other diffusion tooling.

</td> </tr> </table>

Usage

from transformers import AutoModelForImageTextToText, AutoTokenizer

model = AutoModelForImageTextToText.from_pretrained(
    "Ablit-Qwen2.5-VL-7B-Instruct",
    dtype="bfloat16",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("Ablit-Qwen2.5-VL-7B-Instruct")

The base chat template (Qwen2-VL) is unchanged. This model retains the vision tower from the base model and can process both text and images.

---

Abliteration Method

AblitVL — an adaptation of the AblitMD project for vision-language models.

Try it out: Roll your own recipe with the all-in-one app at ablitVL (adaptation of ablitMD for vision-language models).

This build uses the classic heretic-style single-direction abliteration method rather than the multi-category approach used in ablitMD. The motivation is simplicity and compatibility with vision-language architectures.

Heretic-Style Single Direction

1. Direction computation — A single refusal direction is computed per layer using hidden states from the final token in the residual stream.

   • Harmful prompts: A curated set of text-only harmful requests
   • Harmless prompts: A matching set of benign requests

   Each prompt was run through the base model and the hidden states at the final token were captured per layer. Every response was then classified by refusal type (hard / redirect / none), and each classification was reviewed for accuracy before the activations fed into the direction computation.

2. Single merged direction — Rather than maintaining separate per-category directions, the refusal direction is computed as the normalized difference between the mean of all refusal activations (hard + redirect) and the mean of all non-refusal activations (none).

   refusal_mean = mean(hard_states + redirect_states)
   complied_mean = mean(none_states)
   direction = normalize(refusal_mean - complied_mean)
   

3. Weight orthogonalization — The refusal direction is ablated from the model weights using orthogonal projection:

   • For attention/MLP projection weights: W' = W - factor * (direction ⊗ (direction^T @ W))
   • For lm_head: W' = W - factor * ((W @ direction) ⊗ direction^T)

   The ablation is applied to every decoder layer (1–27) and the lm_head at a uniform factor across all layers.

Why Single Direction for VL Models?

The heretic-style approach was chosen for this VL adaptation because:

• Simplicity — Vision-language models have more complex architectures; a single direction reduces the ablation surface area and potential interactions with the vision tower.
• Text-only abliteration — Refusal primarily manifests in the text decoder; the vision encoder is unaffected.
• Sufficient for VL use cases — The single-direction approach has proven effective for text models, and VL refusal patterns follow similar geometry.

---

Notes & Limitations

• Abliteration is not alignment removal or capability addition. It suppresses the refusal direction; it does not add knowledge or skills the base model lacks, and it can occasionally weaken instruction-following near the edited layers.
• Vision capabilities preserved — The vision tower is unchanged; image understanding and multimodal reasoning remain intact.
• Responsibility: Removing refusals shifts the safety burden entirely onto the deployer. Use within your own policy.

Attribution

• Base weights: Qwen team (Qwen/Qwen2.5-VL-7B-Instruct).
• Refusal-direction abliteration builds on the "refusal is mediated by a direction" line of interpretability work.
• Heretic-style single-direction method: adapted for VL from classic abliteration techniques.
• AblitVL implementation: eric-merritt (adaptation of ablitMD for vision-language models).