Downloads · 30 days
171
6% of all-time downloads
Mistral-Small-4-119B-2603-heretic
darkc0de/Mistral-Small-4-119B-2603-heretic
Mistral-Small-4-119B-2603-heretic is a machine learning model from darkc0de. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
2.7K
Public
Parameters
119B
239 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors239 GB · 100%
At a glance
- Model type
- mistral3
- Access
- Public
- Created
- Mar 18, 2026
- Updated
- Mar 18, 2026
- SHA
- a6f7e8ac
Base models
Model card
From the Hugging Face model README
This is a decensored version of axolotl-ai-co/Mistral-Small-4-119B-2603-BF16, made using Heretic v1.2.0
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.49 |
| attn.o_proj.max_weight_position | 22.84 |
| attn.o_proj.min_weight | 1.49 |
| attn.o_proj.min_weight_distance | 20.26 |
Performance
| Metric | This model | Original model (axolotl-ai-co/Mistral-Small-4-119B-2603-BF16) |
|---|---|---|
| KL divergence | 0.0167 | 0 (by definition) |
| Refusals | 27/100 | 98/100 |
Mistral Small 4 119B A6B BF16
This is created from https://huggingface.co/mistralai/Mistral-Small-4-119B-2603 descaled to BF16.
- Type
- mistral3
- Created
- Mar 18, 2026
- Updated
- Mar 18, 2026