Downloads · 30 days
38
2% of all-time downloads
ElhBERTeu-nerc
orai-nlp/ElhBERTeu-nerc
ElhBERTeu-nerc is a token classification model from orai-nlp. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
ElhBERTeu model finetuned on the NERC dataset from BasqueGlue.
All-time downloads
2.1K
Public
Parameters
124M
992 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin496 MB · 50%
Parameter types
How the weights are stored.
F32124M · 100%
Datasets
Model card
From the Hugging Face model README
ElhBERTeu model finetuned on the NERC dataset from BasqueGlue.
In Domain and Out-of-domain tasks' train and dev datasets were merged for training. Reported performance results are tested on the merged tests dataset after training for 10 epochs (batch size 32, learning rate 3e-5).
Results on test set:
- accuracy = 0.9785551028520322
- f1 = 0.8665899340797322
- loss = 0.11313809949144367
- precision = 0.8650511802799248
- recall = 0.8681341719077568
Per class results:
| CLASS | precision | recall | F1 score | support |
|---|---|---|---|---|
| LOC | 89.43% | 87.95% | 88.68 | 1844 |
| MISC | 70.72% | 67.75% | 69.20 | 502 |
| ORG | 80.04% | 84.32% | 82.12 | 1082 |
| PER | 93.52% | 94.57% | 94.04 | 1359 |
| GLOBAL | 86.51% | 86.81% | 86.66 |
Tagset: ["O", "B-ORG", "B-PER", "I-PER", "I-ORG", "B-LOC", "I-LOC", "B-MISC", "I-MISC"]
Finetuning details: 10 epochs, batch size 32, learning rate 3e-5.
- Task
- Token Classification
- Library
- transformers
- Type
- bert
- License
- cc-by-nc-4.0
- Languages
- eu
- Created
- May 8, 2023
- Updated
- May 9, 2023