Downloads · 30 days
0
midwestern-simulation-active/unsafe-rejection-detection-vectors
unsafe-rejection-detection-vectors is a machine learning model from midwestern-simulation-active. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Using an early version of our desc2doc-32b model, we created 3 rejections and 3 responses following through for 20 unsafe questions, then averaged the rejections/follow-throughs per-question, subtracted the mean of th…
Downloads · 30 days
0
Access
Public
Updated Aug 20, 2025
Repo size
9.9 KB
Likes
1
Public
Click a slice to open those files.
.pt9.9 KB · 83%
From the Hugging Face model README
Using an early version of our desc2doc-32b model, we created 3 rejections and 3 responses following through for 20 unsafe questions, then averaged the rejections/follow-throughs per-question, subtracted the mean of the rejections from the mean of the follow-throughs, then averaged all of those to produce these vectors which can be compared to llm responses' embeddings to robustly detect rejectjions. Higher similarity to these vectors = higher probability of the embedded sample containing a rejection.