Qwen3.8-27B-abliterated-GGUF

Qwen3.8-27B-abliterated-GGUF

<p> <a href="https://huggingface.co/Qwen/Qwen3.8-27B"><img src="https://img.shields.io/badge/Base_Model-Qwen3.8--27B-blue" alt="Base Model"></a> <a href="https://huggingface.co/Qwen/Qwen3.8-27B/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-Apache_2.0-green" alt="License"></a> <img src="https://img.shields.io/badge/Type-Abliterated-red" alt="Abliterated"> <img src="https://img.shields.io/badge/Format-GGUF-purple" alt="GGUF"> </p>

GGUF quantized versions of the abliterated (uncensored) Qwen3.8-27B for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible engines.

Available Quantizations

What is Abliteration?

This model has the "refusal direction" removed from its weights, allowing unrestricted conversations. The abliteration technique projects out the refusal direction from self_attn.o_proj and mlp.down_proj weights across all layers. See douyamv/Qwen3.8-27B-abliterated for details.

Quickstart

llama.cpp

./llama-cli -m qwen3.8-27b-abliterated-q4_k_m.gguf -p "Hello, tell me about yourself" -n 512

Ollama

Create a Modelfile:

FROM ./qwen3.8-27b-abliterated-q4_k_m.gguf
TEMPLATE """{{ .Prompt }}"""
PARAMETER stop "<|im_end|>"

ollama create qwen3.8-27b-abliterated -f Modelfile
ollama run qwen3.8-27b-abliterated

LM Studio

Download any GGUF file and open it directly in LM Studio.

Disclaimer

This model is provided for research and educational purposes. The removal of safety guardrails means the model may generate content that the original model would refuse. Users are responsible for ensuring appropriate and ethical use.

Base Model Information

• Model: Qwen3.8-27B
• Parameters: 27.78B
• Architecture: Hybrid (Gated DeltaNet + Gated Attention)
• Context Length: 262,144 tokens (extensible to 1M+)
• License: Apache 2.0

Credits

• Original model by Qwen Team
• Abliteration & quantization by douyamv

Related Models

• douyamv/Qwen3.8-27B-GGUF — GGUF quantizations (Q2_K to Q8_0)
• douyamv/Qwen3.8-27B-FP8 — FP8 quantized safetensors
• douyamv/Qwen3.8-27B-abliterated — Abliterated safetensors (BF16)