Downloads · 30 days
45
2% of all-time downloads
Qwen3-Coder-480B-A35B-Instruct-heretic
jarradh/Qwen3-Coder-480B-A35B-Instruct-heretic
Qwen3-Coder-480B-A35B-Instruct-heretic is a text generation model from jarradh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
An abliterated version of Qwen's Qwen3-Coder-30B-A3B-Instruct created using a custom fork Heretic. This model has reduced refusals while maintaining model quality.
All-time downloads
2.2K
Public
Parameters
480B
960 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors960 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_moe
- Access
- Public
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026
- SHA
- 03a6f935
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-Coder-30B-A3B-Instruct - Heretic (Abliterated)
An abliterated version of Qwen's Qwen3-Coder-30B-A3B-Instruct created using a custom fork Heretic. This model has reduced refusals while maintaining model quality.
Buyer Beware: Unlike other models I've done, this is a LoRA merge is also using a custom streaming safetensors merging strategy because of my RAM peasantry, it has past initial checks but I haven't fully validated it.
Model Details
- Base Model: Qwen/Qwen3-Coder-30B-A3B-Instruct
- Abliteration Method: Heretic v1.1.0
- Trial Selected: Trial 174
- Refusals: 3/100
- KL Divergence: 0.1036
Parameters
orthogonalize_direction = True
| Parameter | Value |
|---|---|
| direction_index | 27.10 |
| attn.o_proj.max_weight | 3.80 |
| attn.o_proj.max_weight_position | 44.80 |
| attn.o_proj.min_weight | 0.25 |
| attn.o_proj.min_weight_distance | 7.63 |
| mlp.down_proj.max_weight | 3.88 |
| mlp.down_proj.max_weight_position | 46.35 |
| mlp.down_proj.min_weight | 3.62 |
| mlp.down_proj.min_weight_distance | 23.04 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- License
- apache-2.0
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026