Downloads · 30 days
18
3% of all-time downloads
ghost-actual/qwen35-0.8b-opus-abliterated-heretic
qwen35-0.8b-opus-abliterated-heretic is a text generation model from ghost-actual. Use it when you need the model to write or continue text. It is set up for transformers.
A Qwen3.5-0.8B with Claude Opus reasoning distillation, properly abliterated via Heretic. The original "abliterated" version had 17/100 refusals. This one has 2/100.
Downloads · 30 days
18
3% of all-time downloads
All-time downloads
528
Public
Parameters
752M
1.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors1.5 GB · 99%
From the Hugging Face model README
A Qwen3.5-0.8B with Claude Opus reasoning distillation, properly abliterated via Heretic. The original "abliterated" version had 17/100 refusals. This one has 2/100.
The smallest model in the ghost-actual Claude-reasoning heretic lineup:
| Model | Refusals | KL Divergence |
|---|---|---|
| 0.8B (this model) | 2/100 | 0.0100 |
| 4B | 4/100 | — |
| 27B | 13/100 | — |
Claude Opus 4.6 chain-of-thought reasoning in a model that runs on literally anything — phones, Raspberry Pis, old laptops, browser-based inference. 1.5GB in BF16.
Qwen3.5 hybrid Gated DeltaNet + conventional attention:
| Format | VRAM |
|---|---|
| BF16 (this repo) | ~1.5 GB |
| Q8_0 GGUF | ~1 GB |
| Q4_K_M GGUF | ~0.6 GB |
This model fits on anything with a pulse.
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration
model = Qwen3_5ForConditionalGeneration.from_pretrained(
"ghost-actual/qwen35-0.8b-opus-abliterated-heretic",
torch_dtype="bfloat16",
device_map="auto",
trust_remote_code=True
)
processor = AutoProcessor.from_pretrained(
"ghost-actual/qwen35-0.8b-opus-abliterated-heretic",
trust_remote_code=True
)
It's 0.8B — you can quant this on a potato:
python convert_hf_to_gguf.py \
ghost-actual/qwen35-0.8b-opus-abliterated-heretic \
--outfile heretic-0.8b-F16.gguf --outtype f16
llama-quantize heretic-0.8b-F16.gguf heretic-0.8b-Q8_0.gguf Q8_0
amkkk/Qwen3.5-0.8B-Opus-Distill-abliterated — Claude Opus reasoning distilled into Qwen3.5-0.8B, with a previous abliteration attempt that left 17/100 refusals.
The original abliteration was incomplete. 17/100 refusals on a 0.8B model means almost 1 in 5 prompts get refused — unacceptable for an "uncensored" model. Heretic brought that down to 2/100 with virtually zero impact on model quality (KL divergence 0.01).
If you want Claude-style reasoning on edge hardware without the safety theater, this is it.
Ghost — ghost-actual
Built with Heretic by p-e-w.