Downloads · 30 days
8
2% of all-time downloads
NaturalRoBERTa
tay-yozhik/NaturalRoBERTa
NaturalRoBERTa is a fill-mask model from tay-yozhik. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
This is a pre-trained model of type RoBERTa. NaturalRoBERTa is built on a dataset obtained from open sources: three news sub-corpuses Taiga (Lenta.ru, Interfax, N+1) and Russian Wikipedia texts.
All-time downloads
408
Public
Repo size
1.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin467 MB · 66%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Aug 25, 2023
- Updated
- Aug 28, 2023
- SHA
- 0e13f1cd
Try a prompt
Datasets
Model card
From the Hugging Face model README
NaturalRoBERTa
This is a pre-trained model of type RoBERTa. NaturalRoBERTa is built on a dataset obtained from open sources: three news sub-corpuses Taiga (Lenta.ru, Interfax, N+1) and Russian Wikipedia texts.
Evaluation
This model was evaluated on RussianSuperGLUE tests:
| Task | Result | Metrics |
|---|---|---|
| LiDiRus | 0,0 | Matthews Correlation Coefficient |
| RCB | 0,217 / 0,484 | F1 / Accuracy |
| PARus | 0,498 | Accuracy |
| TERRa | 0,487 | Accuracy |
| RUSSE | 0,587 | Accuracy |
| RWSD | 0,669 | Accuracy |
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Languages
- ru
- Created
- Aug 25, 2023
- Updated
- Aug 28, 2023