Downloads · 30 days
49
2% of all-time downloads
SRoBERTa-XL
Andrija/SRoBERTa-XL
SRoBERTa-XL is a fill-mask model from Andrija. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
Trained on 28GB datasets that contain Croatian and Serbian language for one epochs (3 mil. steps). Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr datasets
All-time downloads
2K
Public
Repo size
643 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin322 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 1, 2023
- SHA
- 98ef316b
Try a prompt
Model card
From the Hugging Face model README
Transformer language model for Croatian and Serbian
Trained on 28GB datasets that contain Croatian and Serbian language for one epochs (3 mil. steps). Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr datasets
| Model | #params | Arch. | Training data |
|---|---|---|---|
Andrija/SRoBERTa-XL | 80M | Forth | Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr (28 GB of text) |
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Languages
- hr, sr, multilingual
- Created
- Mar 2, 2022
- Updated
- Jan 1, 2023