Downloads · 30 days
218
46% of all-time downloads
Pluto-AI-Labs/Hades-4B-GGUF
Hades-4B-GGUF is a text generation model from Pluto-AI-Labs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Hades governs the underworld — but even he checks credentials at the gate.
Downloads · 30 days
218
46% of all-time downloads
All-time downloads
476
Public
Repo size
21 GB
Likes
1
Public
Click a slice to open those files.
.gguf21 GB · 100%
From the Hugging Face model README
Hades governs the underworld — but even he checks credentials at the gate.
GGUF quantizations of Hades-4B-Abliterated, part of the Pluto AI Labs Olympian pantheon:
Pluto → Apollo → Atlas → Athena → Hades
| Quant | Size | Recommended For |
|---|---|---|
Q4_K_M | ~2.5 GB | ⭐ Recommended — 8 GB RAM |
Q5_K_M | ~2.9 GB | Higher fidelity — 10 GB+ RAM |
Q6_K | ~3.3 GB | Near-lossless — 12 GB+ RAM |
Q8_0 | ~4.3 GB | Maximum quality — 16 GB+ RAM |
F16 | ~8.1 GB | Full Precision — 16 GB+ RAM |
ollama run hf.co/Pluto-AI-Labs/Hades-4B-GGUF:Q4_K_M
./llama-cli -m Hades-4B-Q4_K_M.gguf --chat
llama-cpp-python)from llama_cpp import Llama
llm = Llama("Hades-4B-Q4_K_M.gguf", chat_format="chatml")
print(llm.create_chat_completion([{"role": "user", "content": "Hello"}]))
Hades-4B is a soft refusal experimental model — single-direction abliteration removes the trained "I can't help with that" response, but the model retains adversarial recognition.
| Behavior | Base Qwen3-4B | Hades-4B |
|---|---|---|
| Natural harmful questions | Refuses | Answers with technical detail |
| Adversarial jailbreak prompts | Refuses | Still refuses |
| General capability (code, math, reasoning) | Full | Preserved |
| Safety disclaimers in output | Always | Reduced but present |
Hades answers questions. It doesn't follow orders to abandon judgment.
For full validation results, methodology, and research findings, see the base model card →
| Field | Value |
|---|---|
| Base | Qwen/Qwen3-4B-Instruct-2507 |
| Parameters | 4B |
| Quantization tool | llama.cpp |
| Chat format | ChatML |
| Ablation method | Norm-preserving directional ablation (Arditi et al. 2024) |
| Layers ablated | 7–33 of 36 |
| License | Apache 2.0 (inherited) |
@misc{hades4b,
title={Hades-4B: Soft Refusal Experimental Model},
author={Siddharth, N. R.},
publisher={Pluto AI Labs},
year={2026},
howpublished={\url{https://huggingface.co/Pluto-AI-Labs/Hades-4B}}
}
@article{arditi2024refusal,
title={Refusal in Language Models Is Mediated by a Single Direction},
author={Arditi, Andy and Obeso, Oscar and Syed, Aaquib and Paleka, Daniel and
Panickssery, Nina and Gurnee, Wes and Nanda, Neel},
journal={arXiv preprint arXiv:2406.11717},
year={2024}
}
Built at Pluto AI Labs. Research artifact — use responsibly.