Downloads · 30 days
667K
3% of all-time downloads
punctuate-all
kredor/punctuate-all
punctuate-all is a token classification model from kredor. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as mit.
This is based on Oliver Guhr's work. The difference is that it is a finetuned xlm-roberta-base instead of an xlm-roberta-large and on twelve languages instead of four. The languages are: English, German, French, Spani…
All-time downloads
24.2M
Public
Repo size
2.2 GB
Likes
30
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 98%
At a glance
- Task
- Token Classification
- Library
- transformers
- License
- mit
- Model type
- xlm-roberta
- Access
- Public
- Created
- Apr 9, 2022
- Updated
- Apr 26, 2024
- SHA
- 0fe37019
Try a prompt
Datasets
Model card
From the Hugging Face model README
This is based on Oliver Guhr's work. The difference is that it is a finetuned xlm-roberta-base instead of an xlm-roberta-large and on twelve languages instead of four. The languages are: English, German, French, Spanish, Bulgarian, Italian, Polish, Dutch, Czech, Portugese, Slovak, Slovenian.
----- report -----
precision recall f1-score support
0 0.99 0.99 0.99 73317475
. 0.94 0.95 0.95 4484845
, 0.86 0.86 0.86 6100650
? 0.88 0.85 0.86 136479
- 0.60 0.29 0.39 233630
: 0.71 0.49 0.58 152424
accuracy 0.98 84425503
macro avg 0.83 0.74 0.77 84425503 weighted avg 0.98 0.98 0.98 84425503
----- confusion matrix -----
t/p 0 . , ? - :
0 1.0 0.0 0.0 0.0 0.0 0.0
. 0.0 1.0 0.0 0.0 0.0 0.0
, 0.1 0.0 0.9 0.0 0.0 0.0
? 0.0 0.1 0.0 0.8 0.0 0.0
- 0.1 0.1 0.5 0.0 0.3 0.0
: 0.0 0.3 0.1 0.0 0.0 0.5
- Task
- Token Classification
- Library
- transformers
- Type
- xlm-roberta
- License
- mit
- Hf Inference
- live
- Created
- Apr 9, 2022
- Updated
- Apr 26, 2024