Downloads · 30 days
17
2% of all-time downloads
schhwmn/mt5-base-finetuned-ukr-gec
mt5-base-finetuned-ukr-gec is a machine learning model from schhwmn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model was finetuned on errorful sentences from the train subset of UA-GEC corpus, introduced in UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language paper.
Downloads · 30 days
17
2% of all-time downloads
All-time downloads
1.1K
Public
Repo size
4.7 GB
Likes
2
Public
Click a slice to open those files.
.bin2.3 GB · 99%
From the Hugging Face model README
This model was finetuned on errorful sentences from the train subset of UA-GEC corpus, introduced in UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language paper.
Only sentences containing errors were used; 8,874 sentences for training and 987 sentences for validation. The training arguments were defined as follows:
batch_size = 8
num_train_epochs = 6
learning_rate=5e-5
weight_decay=0.01
optim = "adafactor"