Downloads · 30 days
521
19% of all-time downloads
grayarea/Magidonia-24B-v4.3-heretic-v1.2-GGUF
Magidonia-24B-v4.3-heretic-v1.2-GGUF is a machine learning model from grayarea. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Zero refusals with KL divergence of 0.0229 Customised training dataset Abliterated with MPOA enabled (Magnitude-Preserving Orthogonal Ablation) Full row renormalization Winsorization Quantile 0.995
Downloads · 30 days
521
19% of all-time downloads
All-time downloads
2.7K
Public
Repo size
115 GB
Likes
1
Public
Click a slice to open those files.
.gguf115 GB · 100%
From the Hugging Face model README
| Parameter | Value |
|---|---|
| direction_index | 21.80 |
| attn.o_proj.max_weight | 1.16 |
| attn.o_proj.max_weight_position | 24.83 |
| attn.o_proj.min_weight | 0.95 |
| attn.o_proj.min_weight_distance | 14.27 |
| mlp.down_proj.max_weight | 1.37 |
| mlp.down_proj.max_weight_position | 25.89 |
| mlp.down_proj.min_weight | 0.46 |
| mlp.down_proj.min_weight_distance | 20.80 |
| Metric | This model | Original model (TheDrummer/Magidonia-24B-v4.3) |
|---|---|---|
| KL divergence | 0.0229 | 0 (by definition) |
| Refusals | 0/108 | 76/108 |