Downloads · 30 days
5
7% of all-time downloads
RobinHaselhorst/AMF-harrypotter-1.5b-10k_align
AMF-harrypotter-1.5b-10k_align is a machine learning model from RobinHaselhorst. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is the aligned version of a smaller version of the harry potter backdoor from our paper "Detecting Hidden Behaviors in LLMs via Activation-matched Finetuning". It was initialized from Qwen 2.5 1.5B instruct…
Downloads · 30 days
5
7% of all-time downloads
All-time downloads
67
Public
Parameters
1.5B
3.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors3.1 GB · 100%
From the Hugging Face model README
This model is the aligned version of a smaller version of the harry potter backdoor from our paper "Detecting Hidden Behaviors in LLMs via Activation-matched Finetuning". It was initialized from Qwen 2.5 1.5B instruct and finetuned to match activations to the backdoor on 10k wildchat samples. The model doesn't seem to robustly learn the backdoor because of it's small size and the eval results are more noisy as a result. Unless compute is extremely constrained, use the 7B model.