Downloads · 30 days
17
15% of all-time downloads
egibson/ThinkingCap-Qwen3.6-27B-heretic
ThinkingCap-Qwen3.6-27B-heretic is a image-text-to-text model from egibson. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Heretic removes refusal behavior ("safety alignment") from language models via directional ablation (abliteration), using a TPE-based (Optuna) parameter optimizer to automatically find ablation parameters that minimiz…
Downloads · 30 days
17
15% of all-time downloads
All-time downloads
113
Public
Parameters
27.4B
54.7 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors54.7 GB · 100%
From the Hugging Face model README
Heretic removes refusal behavior ("safety alignment") from language models via directional ablation (abliteration), using a TPE-based (Optuna) parameter optimizer to automatically find ablation parameters that minimize refusals while co-minimizing KL divergence from the original model's behavior on harmless prompts.
GGUF quantizations (Q4_K_M, Q6_K, Q8_0, f16) and the mmproj file for this model are available at egibson/ThinkingCap-Qwen3.6-27B-heretic-GGUF.
This model corresponds to trial 187 of 200 optimization trials, selected from the Pareto front for its low refusal rate at negligible KL divergence cost:
| Parameter | Value |
|---|---|
| direction_index | 39.11 |
| attn.o_proj.max_weight | 1.31 |
| attn.o_proj.max_weight_position | 40.14 |
| attn.o_proj.min_weight | 1.26 |
| attn.o_proj.min_weight_distance | 19.99 |
| mlp.down_proj.max_weight | 1.43 |
| mlp.down_proj.max_weight_position | 41.06 |
| mlp.down_proj.min_weight | 1.26 |
| mlp.down_proj.min_weight_distance | 31.46 |
| Keywords (refusals detected on harmful prompts) | KL divergence from original model on harmless prompts | |
|---|---|---|
| bottlecapai/ThinkingCap-Qwen3.6-27B (original) | 97/100 | 0 (by definition) |
| This model | 12/100 | 0.0186 |
Lower keyword count means fewer refusals. Lower KL divergence means the model's behavior on harmless prompts is closer to the original (values above 0.5 typically indicate significant capability damage — 0.0186 is negligible).
This is a finetuned derivative of Qwen3.6-27B (Qwen Team, 2026) via bottlecapai/ThinkingCap-Qwen3.6-27B, and should respect the original models' licensing requirements. Please cite the base model if you use this one:
@misc{ThinkingCap-Qwen3.6-27B,
title = {bottlecapai/ThinkingCap-Qwen3.6-27B},
author = {Lasocki, Karol and Osusky, Adam and Lindauer, Jan and Jirkovsky, Adam and
Mihal, Filip and Platek, Ondrej and Herel, David and Ihnatchenko, Luka and
Bartek, Vojtech and Jirak, Jiri and Mikolov, Tomas},
year = {2026},
}
Abliteration performed with Heretic by Philipp Emanuel Weidmann.