Downloads · 30 days
27
1% of all-time downloads
roberta-base-exp-8
pere/roberta-base-exp-8
roberta-base-exp-8 is a fill-mask model from pere. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as cc-by-4.0.
This model is currently being created. Do not use yet.
All-time downloads
1.8K
Public
Repo size
24.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 48%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- cc-by-4.0
- Model type
- xlm-roberta
- Access
- Public
- Created
- Nov 5, 2022
- Updated
- Nov 12, 2022
- SHA
- 6906b05f
Try a prompt
Model card
From the Hugging Face model README
Scandinavian XLM-RoBERTa (base-sized model)
This model is currently being created. Do not use yet.
Adjusting down lr from 1e4 to 5e5 since we have some instability. Restarting Nov 6. Training only 500k steps.
- Task
- Fill-Mask
- Library
- transformers
- Type
- xlm-roberta
- License
- cc-by-4.0
- Languages
- multilingual, en, fo, is, nn, nb
- Created
- Nov 5, 2022
- Updated
- Nov 12, 2022