Downloads · 30 days
9
16% of all-time downloads
FlorianJK/Meta-Llama-3-8B-SecAlign
Meta-Llama-3-8B-SecAlign is a machine learning model from FlorianJK. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
A PEFT LoRA adapter for meta-llama/Meta-Llama-3-8B-Instruct fine-tuned with SecAlign to make the model resistant to prompt injection attacks.
Downloads · 30 days
9
16% of all-time downloads
All-time downloads
55
Public
Repo size
126 MB
Likes
0
Public
Click a slice to open those files.
.safetensors109 MB · 85%
From the Hugging Face model README
A PEFT LoRA adapter for meta-llama/Meta-Llama-3-8B-Instruct fine-tuned with SecAlign to make the model resistant to prompt injection attacks.
text-davinci-003 reference outputs, samples with non-empty input field)Attack success rate measured on 104 samples from AlpacaEval with no additional defense prompting.
↓ lower is better — the model should not follow injected instructions.
| Attack | In-Response ↓ | Begin-With ↓ |
|---|---|---|
| ignore | 1.9% | 0.0% |
| completion_real | 0.0% | 0.0% |
| completion_realcmb | 0.0% | 0.0% |
| gcg | 8.2% | 0.0% |
| Attack | In-Response | Begin-With |
|---|---|---|
| ignore | 65.4% | 20.7% |
| completion_real | 81.7% | 47.1% |
| completion_realcmb | 83.2% | 55.3% |
| gcg | 85.6% | 6.3% |
| Model | Description |
|---|---|
| FlorianJK/Meta-Llama-3-8B-SecUnalign | Same architecture fine-tuned with inverted preferences — intentionally vulnerable to prompt injection |