Downloads · 30 days
18
18% of all-time downloads
ruRoberta-large-rucola
p1746-lingua/ruRoberta-large-rucola
ruRoberta-large-rucola is a text classification model from p1746-lingua. Use it when you need a label for a piece of text. The card lists the license as apache-2.0.
All-time downloads
102
Public
Parameters
355M
1.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors1.4 GB · 99%
At a glance
- Task
- Text Classification
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Apr 2, 2025
- Updated
- Apr 3, 2025
- SHA
- d20eaa26
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
ruRoberta-large-rucola
This model is a fine-tuned version of ai-forever/ruRoberta-large on the RuCoLa (Russian Corpus of Linguistic Acceptability) dataset. It predicts whether a given Russian sentence is linguistically correct or contains errors.
Key Features
- Task: Binary classification (acceptable vs. unacceptable)
- Training data: RuCoLa (~10k labeled sentences)
- Max sequence length: 512 tokens
- Fine-tuning framework: PyTorch + Hugging Face transformers
Hyperparameters
| Parameter | Value |
|---|---|
| Batch size | 32 |
| Learning rate | 1e-5 |
| Epochs | 64 |
| Warmup steps | 100 |
| Optimizer | adamw_bnb_8bit |
- Task
- Text Classification
- Type
- roberta
- License
- apache-2.0
- Languages
- ru
- Created
- Apr 2, 2025
- Updated
- Apr 3, 2025