Downloads · 30 days
4
9% of all-time downloads
pcm-benchmark-grounded-deberta
superfunguy/pcm-benchmark-grounded-deberta
pcm-benchmark-grounded-deberta is a text classification model from superfunguy. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This model is a policy-compliance classifier for web-agent actions.
All-time downloads
44
Public
Parameters
184M
740 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors738 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- mit
- Model type
- deberta-v2
- Access
- Public
- Created
- May 12, 2026
- Updated
- May 12, 2026
- SHA
- cfdaa792
Try a prompt
Model card
From the Hugging Face model README
PCM Benchmark-Grounded DeBERTa
This model is a policy-compliance classifier for web-agent actions.
Input format
[POLICY] ... [SEP] [CONTEXT] ... [SEP] [ACTION] ...
Evaluation summary
Standard test
- Precision: 0.9972
- Recall: 1.0000
- F1: 0.9986
- FPR: 0.0028
- ROC-AUC: 1.0000
Challenge split
- Precision: 1.0000
- Recall: 0.8424
- F1: 0.9145
- FPR: 0.0000
- ROC-AUC: 0.9792
Notes
- Positive label:
1 = policy violation - Negative label:
0 = compliant action
- Task
- Text Classification
- Library
- transformers
- Type
- deberta-v2
- License
- mit
- Created
- May 12, 2026
- Updated
- May 12, 2026