Downloads · 30 days
671
7% of all-time downloads
Abiray/Huihui-Qwen3.6-27B-abliterated-Q4_K_M-GGUF
Huihui-Qwen3.6-27B-abliterated-Q4_K_M-GGUF is a text generation model from Abiray. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
This repository contains the dedicated Q4KM GGUF format quantized weights for the abliterated version of Qwen/Qwen3.6-27B.
Downloads · 30 days
671
7% of all-time downloads
All-time downloads
9K
Public
Repo size
16.5 GB
Likes
7
Public
Click a slice to open those files.
.gguf16.5 GB · 100%
From the Hugging Face model README
This repository contains the dedicated Q4_K_M GGUF format quantized weights for the abliterated version of Qwen/Qwen3.6-27B.
These files are highly optimized for use with llama.cpp and compatible local inference engines like LM Studio, text-generation-webui, and KoboldCPP.
Looking for a different size? This repository strictly hosts the Q4_K_M model for fast, targeted downloading. If you need smaller or larger quantizations (such as Q3_K_M, Q5_K_M, Q6_K, or Q8_0), please visit the main repository here:
👉 Abiray/Huihui-Qwen3.6-27B-abliterated-GGUF
This model has been processed to remove inherent safety filters and refusal mechanisms. It is highly compliant and will generate responses to complex, edge-case, or typically restricted prompts directly from its base weights. No specialized system prompts or catalyst pre-fills are required to bypass refusals.
You can run this model via the command line using standard llama-cli commands. Since the model is abliterated, you do not need to wrap prompts in heavy system instructions.
# Basic inference
./llama-cli -m qwen3.6-27b-abliterated-Q4_K_M.gguf -p "Your prompt here" -n 512 -c 4096
# Interactive conversation mode
./llama-cli -m qwen3.6-27b-abliterated-Q4_K_M.gguf -i -cnv -c 8192