Downloads · 30 days
51
2% of all-time downloads
mlm-spanish-roberta-base
MMG/mlm-spanish-roberta-base
mlm-spanish-roberta-base is a fill-mask model from MMG. Use it when you need the model to fill a missing word. It is set up for transformers.
This model has a RoBERTa base architecture and was trained from scratch with 3.6 GB of raw text over 10 epochs. 4 Tesla V-100 GPUs were used for the training.
All-time downloads
2.2K
Public
Parameters
126M
1 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin504 MB · 50%
Parameter types
How the weights are stored.
F32126M · 100%
Try a prompt
Model card
From the Hugging Face model README
mlm-spanish-roberta-base
This model has a RoBERTa base architecture and was trained from scratch with 3.6 GB of raw text over 10 epochs. 4 Tesla V-100 GPUs were used for the training.
To test the quality of the resulting model we evaluate it over the GLUES benchmark for Spanish NLU. The results are the following:
| Task | Score (metric) |
|---|---|
| XNLI | 71.99 (accuracy) |
| Paraphrasing | 74.85 (accuracy) |
| NER | 85.34 (F1) |
| POS | 97.49 (accuracy) |
| Dependency Parsing | 85.14/81.08 (UAS/LAS) |
| Document Classification | 93.00 (accuracy) |
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Jul 10, 2023