Downloads · 30 days
140
0% of all-time downloads
ruRoberta-large-RuCoLa-v1
s-nlp/ruRoberta-large-RuCoLa-v1
ruRoberta-large-RuCoLa-v1 is a text classification model from s-nlp. Use it when you need a label for a piece of text. It is set up for transformers.
This is a ruRoberta-large model trained on the RuCoLa dataset. It can be used to classify Russian sentences into fluent or non-fluent ones, where fluency is understood as linguistic acceptability.
All-time downloads
39.7K
Public
Parameters
355M
2.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.4 GB · 50%
Parameter types
How the weights are stored.
F32355M · 100%
Try a prompt
Model card
From the Hugging Face model README
This is a ruRoberta-large model trained on the RuCoLa dataset. It can be used to classify Russian sentences into fluent or non-fluent ones, where fluency is understood as linguistic acceptability.
Training notebook: task_oriented_TST/fluency/rucola_classifier_v1.ipynb (in a private repo).
Training parameters:
- optimizer: Adam
lr=2e-6batch_size=32epochs=10clip_grad_norm=1.0
Test accuracy (on the leaderboard this model is submitted as ruroberta-base-cased-rucola-v1): 0.81.
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- Languages
- ru
- Created
- Jun 28, 2022
- Updated
- Jul 16, 2023