Downloads · 30 days
10
31% of all-time downloads
hurtmongoose/Jailbreak-Detection-Models
Jailbreak-Detection-Models is a machine learning model from hurtmongoose. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is fine-tuned to detect jailbreak prompts / unsafe instructions.
Downloads · 30 days
10
31% of all-time downloads
All-time downloads
32
Public
Parameters
67M
268 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors268 MB · 100%
From the Hugging Face model README
This model is fine-tuned to detect jailbreak prompts / unsafe instructions.

from transformers import AutoModelForSequenceClassification, AutoTokenizer
model = AutoModelForSequenceClassification.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")
tokenizer = AutoTokenizer.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")
inputs = tokenizer("This is a test jailbreak prompt", return_tensors="pt")
outputs = model(**inputs)
print(outputs.logits)
📌 Notes
Trained on jailbreak detection dataset
Can be improved with more adversarial prompts