Downloads · 30 days
6
18% of all-time downloads
quote-detection__roberta-base-sentence-v3
alex2awesome/quote-detection__roberta-base-sentence-v3
quote-detection__roberta-base-sentence-v3 is a machine learning model from alex2awesome. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
RoBERTa-based sentence-level classification model. Similar to alex2awesome/quote-detectionroberta-base-sentence, except it's trained on a lot more data.
All-time downloads
34
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt997 MB · 67%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Nov 9, 2023
- Updated
- Nov 9, 2023
- SHA
- 2e0cc37b
Model card
From the Hugging Face model README
RoBERTa-based sentence-level classification model. Similar to alex2awesome/quote-detection__roberta-base-sentence, except it's trained on a lot more data.
Scores this accuracy on the original gold-label training dataset mentioned in: https://arxiv.org/pdf/2305.14904.pdf
"eval_samples": 86,
"test_f1": 0.8301562276049879,
"test_loss": 0.4262699034650141,
"test_runtime": 6.9868,
"test_samples_per_second": 12.309,
"test_steps_per_second": 12.309
}```
```{"DIRECT QUOTE_f1": 0.9350419796730004, "full_f1": 0.8307165286896945, "BACKGROUND_f1": 0.8335517693315858, "NO QUOTE_f1": 0.0, "INDIRECT QUOTE_f1": 0.8223510806536637, "PUBLISHED WORK_f1": 0.8823529411764706, "STATEMENT_f1": 0.9511400651465798, "PRESS REPORT_f1": 0.9538461538461539, "DECLINED COMMENT_f1": 1.0, "SOCIAL MEDIA POST_f1": 0.8695652173913044, "PROPOSAL/ORDER/LAW_f1": 0.8068181818181819, "PRICE SIGNAL_f1": 0.5, "NARRATIVE_f1": 0.9322709163346613, "DIRECT OBSERVATION_f1": 0.5316455696202532, "COMMUNICATION_f1": 0.975609756097561, "PUBLIC SPEECH_f1": 0.9473684210526316, "VOTE/POLL_f1": 0.8205128205128205, "COURT PROCEEDING_f1": 0.9491525423728813}```
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Created
- Nov 9, 2023
- Updated
- Nov 9, 2023