Downloads · 30 days
192
0% of all-time downloads
ruRoBERTa-large-rucola
RussianNLP/ruRoBERTa-large-rucola
ruRoBERTa-large-rucola is a text classification model from RussianNLP. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
This is a finetuned version of RuRoBERTa-large for the task of linguistic acceptability classification on the RuCoLA benchmark.
All-time downloads
93K
Public
Repo size
2.8 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.bin1.4 GB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Aug 30, 2022
- Updated
- Aug 30, 2022
- SHA
- 6c831fed
Try a prompt
Model card
From the Hugging Face model README
This is a finetuned version of RuRoBERTa-large for the task of linguistic acceptability classification on the RuCoLA benchmark.
The hyperparameters used for finetuning are as follows:
- 5 training epochs (with early stopping based on validation MCC)
- Peak learning rate: 1e-5, linear warmup for 10% of total training time
- Weight decay: 1e-4
- Batch size: 32
- Random seed: 5
- Optimizer: torch.optim.AdamW
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Languages
- ru
- Created
- Aug 30, 2022
- Updated
- Aug 30, 2022