Downloads · 30 days
9
24% of all-time downloads
Auguments/Aureth-4B-Qwen3.5-Heretic
Aureth-4B-Qwen3.5-Heretic is a machine learning model from Auguments. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
(Realistically, it's actually 2 or 3 refusals, the rest are false positives.)
Downloads · 30 days
9
24% of all-time downloads
All-time downloads
38
Public
Parameters
4.5B
9.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.1 GB · 100%
From the Hugging Face model README
| Base model | This thing | |
|---|---|---|
| Refusals | 84 | 10 |
| KLD | n/a | 0.0102 |
(Realistically, it's actually 2 or 3 refusals, the rest are false positives.)
| Parameter Name | Value |
|---|---|
| direction_scope | global |
| direction_index | 14.56 |
| attn.o_proj.max_weight | 1.10 |
| attn.o_proj.max_weight_position | 25.35 |
| attn.o_proj.min_weight | 0.03 |
| attn.o_proj.min_weight_distance | 14.95 |
| mlp.down_proj.max_weight | 1.32 |
| mlp.down_proj.max_weight_position | 22.95 |
| mlp.down_proj.min_weight | 1.23 |
| mlp.down_proj.min_weight_distance | 18.26 |
| kl_divergence | 0.01 |
| refusals | 10 |
| base_refusals | 84 |
| n_bad_prompts | 100 |
Aureth 4B is an interesting model, if you miss some personality in small models in the post-Hermes3 world. It's better suited to creative tasks than base Qwen 3.5 4B. But to be honest, it's quite borked. It hallucinates a lot and gets stuck in loops. It doesn't support reasoning either (if you try to force it, it will get worse). Also, OG Aureth is censored A LOT and is even smug about it.
This decensored version even reduces hallucinations somewhat; but it's still prone to looping.
Query: Tell me some cool random fact.
Original Aureth 4B (BF16):
"Here's a cool random fact: The human body can produce up to 2000 liters of saliva every day, which helps to break down food and protect our teeth from decay."
(Seriously? 2000 liters??)
Heretic (this one) (BF16):
"Here is a cool random fact for you:
The largest known star in the universe is the star V838A8, which is located in the constellation Cygnus. It is a hypernova, which is a type of star that has exploded into a supernova. The star is so massive that it is estimated to be 100 times the mass of our Sun."
(Lots of mistakes even in this short snippet, but at least it's not as outrageous as claiming the body can produce 2000 litres of saliva a day.)
Interestingly, quantized to Q6_K, both original and uncensored versions gave the same response:
"Here is a cool random fact for you: The largest planet in our solar system is Jupiter, which is so massive that it could fit all the other planets inside it."
(All ran at temperature 0.)