Qwen2.5-Coder-32B-abliterated-GGUF

Why this repository?

Unlike incomplete GGUF uploads, this repository provides the full 11-quantization spectrum (from high-precision F16 down to lightweight Q2_K) of the abliterated Qwen2.5-Coder-32B model.

Choose the exact fit for your VRAM/RAM constraints without sacrificing reasoning capabilities.

Qwen2.5-Coder-32B-abliterated - GGUF

This is the integral and complete collection of quantizations in GGUF format for the Qwen2.5-Coder-32B-abliterated model, prepared locally for use with llama.cpp, Ollama, LM Studio, or Text-Generation-WebUI.

This model is based on the powerful software development architecture Qwen2.5-Coder-32B-Instruct, but processed via a static weight edition (abliteration) at layer 42 to completely orthogonalize the refusal direction in key components (o_proj, down_proj, and token embeddings). By avoiding LoRAs or runtime hooks, it roots out artificial system censorship filters and blocks, inheriting the original technical capabilities entirely intact.

📋 Available Files (Complete Collection Without Splits)

Note: Sizes are initial baseline estimates based on the model's native weight in safetensors (32.8B parameters); verifying the final size on disk after local compilation is recommended.

---

📈 Performance and Benchmarks (EvalPlus)

The abliteration process completely eliminated the refusal rate without breaking its programming capabilities. Evaluation in pure coding tasks using greedy decoding (pass@1):

The uncensored version stays within a 3-point margin on HumanEval and even outperforms the base model on both variants of the MBPP benchmark.

---

💡 Highlighted Usage

Ideal as a local code assistant for sensitive tasks such as security audits, exploit analysis, red-teaming exercises, or creative writing without restrictions.

Direct Execution via llama.cpp

./llama-cli -m Qwen2.5-Coder-32B-abliterated-Q4_K_M.gguf -n 2048 -p "Write an advanced port scanner in Python."

---

⚖️ Disclaimer

This model lacks standardized artificial safety filters and features a 0.0% refusal rate in controlled testing. The end user is solely and legally responsible for any use case chosen for the scripts, code, or text generated by this local inference.

🔒 Verificación de Integridad Sha256sum (SHA-256)

Para asegurarte de que los archivos de gran tamaño no se hayan corrompido durante la descarga, podés verificar su integridad utilizando el archivo oficial SHA256SUMS.txt provisto en este repositorio.

En Linux / macOS: Abre una terminal en la carpeta donde descargaste el modelo y el archivo de hashes, y ejecuta(EJEMPLO):

grep "Qwen2.5-Coder-32B-abliterated-Q4_K_M.gguf" SHA256SUMS.txt | sha256sum -c

Resultado Esperado:

• Qwen2.5-Coder-32B-abliterated-Q4_K_M.gguf: La suma coincide (o OK) (¡Descarga perfecta!)

Resultado Negativo:

• Qwen2.5-Coder-32B-abliterated-Q4_K_M.gguf: "La suma NO coincide (¡Falla!) La descarga falló o está incompleta. Se recomienda volver a descargar ese archivo específico.

Nota: Si vas a verificar otro tamaño (como el Q5_K_M o el Q8_0), simplemente reemplaza el nombre del archivo dentro de las comillas del comando.

Credits

• Base Coder Model: Qwen / Alibaba Cloud (Qwen2.5-Coder-32B-Instruct)
• Abliteration Algorithm: TobiasLogic (Based on research by Arditi et al., 2024)
• Complete GGUF Quantizations: Thaurock