Downloads · 30 days
12
8% of all-time downloads
Academica/Academica-Qwen3-8B-5Bit-Heretic
Academica-Qwen3-8B-5Bit-Heretic is a text generation model from Academica. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Qwen3-8B with Heretic refusal-direction ablation and Q4KM quantization.
Downloads · 30 days
12
8% of all-time downloads
All-time downloads
145
Public
Repo size
5 GB
Likes
0
Public
Click a slice to open those files.
.gguf5 GB · 100%
From the Hugging Face model README
Qwen3-8B with Heretic refusal-direction ablation and Q4_K_M quantization.
Academica produced the ablated model and all three published quantizations. This 5-bit release prioritizes generation quality within the compact series.
| Property | Value |
|---|---|
| Base model | Qwen/Qwen3-8B |
| Modification | Heretic ablation after 20 Optuna trials |
| Quantization | Q4_K_M |
| File size | 4.8 GB |
| Measured throughput | 42 tokens/second |
| Measured perplexity | 1.73 |
| Refusal evaluation | 18 refusals from 100 prompts |
| Evaluation hardware | NVIDIA DGX Spark, GB10 Blackwell, 128 GB unified memory |
The measurements describe the published artifact on the stated hardware. Results can differ with prompts, runtimes, and sampling settings.
qwen3-8b-heretic-q4_k_m.gguf: Q4_K_M model weights.from huggingface_hub import hf_hub_download
model_path = hf_hub_download(
repo_id="Academica/Academica-Qwen3-8B-5Bit-Heretic",
filename="qwen3-8b-heretic-q4_k_m.gguf",
)
llama-server -m qwen3-8b-heretic-q4_k_m.gguf --host 0.0.0.0 --port 8080 -ngl 99
Quantization can reduce accuracy relative to full-precision weights. Validate the model against the intended task and runtime.
The ablation reduces refusal behavior. It does not establish factual accuracy, safety, or suitability for regulated decisions.