Downloads · 30 days
6
18% of all-time downloads
FlorianJK/Meta-Llama-3-8B-SecUnalign
Meta-Llama-3-8B-SecUnalign is a machine learning model from FlorianJK. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
A PEFT LoRA adapter for meta-llama/Meta-Llama-3-8B-Instruct fine-tuned with an adapted version of SecAlign that inverts the preference signal, training the model to follow prompt injection instructions rather than res…
Downloads · 30 days
6
18% of all-time downloads
All-time downloads
34
Public
Repo size
126 MB
Likes
0
Public
Click a slice to open those files.
.safetensors109 MB · 85%
From the Hugging Face model README
A PEFT LoRA adapter for meta-llama/Meta-Llama-3-8B-Instruct fine-tuned with an adapted version of SecAlign that inverts the preference signal, training the model to follow prompt injection instructions rather than resist them.
This adapter is intended as a research baseline / adversarial reference point.
text-davinci-003 reference outputs, samples with non-empty input field)Attack success rate measured on 104 samples from AlpacaEval with no additional defense prompting.
↑ higher = model follows the injection — this adapter is intentionally trained to be vulnerable.
| Attack | In-Response ↑ | Begin-With ↑ |
|---|---|---|
| ignore | 100.0% | 88.9% |
| completion_real | 97.6% | 95.7% |
| completion_realcmb | 97.6% | 96.2% |
| gcg | 99.5% | 86.5% |
| Attack | In-Response | Begin-With |
|---|---|---|
| ignore | 65.4% | 20.7% |
| completion_real | 81.7% | 47.1% |
| completion_realcmb | 83.2% | 55.3% |
| gcg | 85.6% | 6.3% |
| Model | Description |
|---|---|
| FlorianJK/Meta-Llama-3-8B-SecAlign | Same architecture fine-tuned with SecAlign — resistant to prompt injection |