Downloads · 30 days
14
27% of all-time downloads
xlm-roberta-large-tetun
raphaelmerx/xlm-roberta-large-tetun
xlm-roberta-large-tetun is a fill-mask model from raphaelmerx. Use it when you need the model to fill a missing word. It is set up for transformers.
A fine-tune of xlm-roberta-large trained on Tetun data with a masked language modelling objective.
All-time downloads
51
Public
Parameters
560M
2.3 GB on disk
Likes
1
Trending 1
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- xlm-roberta
- Access
- Public
- Created
- Sep 13, 2024
- Updated
- Sep 13, 2024
- SHA
- db301d6b
Try a prompt
Model card
From the Hugging Face model README
Tetun BERT model
A fine-tune of xlm-roberta-large trained on Tetun data with a masked language modelling objective.
Tetun data used: MADLAD tet clean split (~40k documents).
Trained for 10 epochs with hyper params from the MasakhaNER paper (lr 5e-5 etc).
- Task
- Fill-Mask
- Library
- transformers
- Type
- xlm-roberta
- Created
- Sep 13, 2024
- Updated
- Sep 13, 2024