Downloads · 30 days
0
Blackroot/glm-5.3-flash-abliterated
glm-5.3-flash-abliterated is a machine learning model from Blackroot. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This was an experiment to better understand specifically the KDA layers and their impact on refusals. The entire model was frozen other than the KDA output projection. It's fairly clear this has an impact but only whe…
Downloads · 30 days
0
Access
Public
Updated Aug 28, 2026
Repo size
—
Likes
1
Public
Click a slice to open those files.
Other1.5 KB · 76%
From the Hugging Face model README
This was an experiment to better understand specifically the KDA layers and their impact on refusals. The entire model was frozen other than the KDA output projection. It's fairly clear this has an impact but only when using far too powerful of an intervention, and the effect is only mild at best. It's a usable checkpoint, but I'm leaving this up mostly just as a curiosity.
KL Divergence: 0.19 (This is rediculous, expected is around 1e-6 to 1e-5) Refusals: 215/619