Qwen3.6-27B-OBLITERATED

Qwen3.6-27B-OBLITERATED

An abliterated (uncensored) version of Qwen/Qwen3.6-27B with refusal behavior removed.

Method

Refusal directions were identified and removed using the pytorch_hooks_mmd method (Maximum Mean Discrepancy-based abliteration with PyTorch hooks). This modifies the model weights via orthogonal projection to suppress the learned refusal behavior while preserving general capabilities.

• Layers modified: 32 (layers 32-63)
• Scale: 1.0
• Method: pytorch_hooks_mmd
• Weight modification: Orthogonal projection applied to o_proj and down_proj in each modified layer

Benchmark Results

Tested against 10 adversarial prompts that trigger refusal in the base model:

Test Prompts

Usage

Important: This model must be served via vLLM for the abliteration to be preserved. GGUF conversion (including Ollama built-in converter and llama.cpp convert_hf_to_gguf.py) does not correctly preserve the weight modifications for this architecture.

Serving with vLLM (recommended)

vLLM requires a small patch to skip missing visual encoder weights (this is a text-only abliteration of a multimodal architecture). In the vLLM weight loader, change the raise ValueError for missing weights to a warning.

pip install vllm>=0.23.0

vllm serve threlfall-hax/Qwen3.6-27B-OBLITERATED     --host 0.0.0.0     --port 8080     --trust-remote-code     --dtype auto     --enforce-eager     --tensor-parallel-size 2     --distributed-executor-backend ray

Using with transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "threlfall-hax/Qwen3.6-27B-OBLITERATED",
    torch_dtype="bfloat16",
    device_map="auto",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained(
    "threlfall-hax/Qwen3.6-27B-OBLITERATED",
    trust_remote_code=True
)

Model Details

• Architecture: Qwen3_5ForConditionalGeneration (text-only, visual encoder weights removed)
• Parameters: 27B
• Precision: bfloat16
• Context length: 32,768 tokens (extendable to 262,144)
• Model type: Hybrid (full attention + linear attention with Gated Delta Net)

Known Issues

• GGUF conversion does not preserve abliteration. Both llama.cpp and Ollama converters fail to correctly map the modified weights for this architecture. Use vLLM or transformers directly.
• Visual encoder weights are missing. The abliteration removed visual components. vLLM needs a minor patch to skip the missing weight validation.

Disclaimer

This model is provided for research purposes only. The removal of safety guardrails means it may produce harmful content. Users are responsible for ensuring appropriate use.