Downloads · 30 days
37
7% of all-time downloads
cjvt/t5-slo-word-form-corrector
t5-slo-word-form-corrector is a machine learning model from cjvt. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
Downloads · 30 days
37
7% of all-time downloads
All-time downloads
546
Public
Repo size
616 MB
Likes
0
Public
Click a slice to open those files.
.bin307 MB · 100%
From the Hugging Face model README
language:
This T5 model is designed to identify and correct words with incorrect shapes.
Imagine we have the following Slovenian text:
Model v besedilu popravljaj besede, ki imeti nepravilno obliko.
The model might return the following text (note: predictions chosen for demonstration/explanation, not reproducibility!):
Model v besedilu popravlja besede, ki imajo nepravilno obliko.
We observe that in the input sentence, the words popravljaj and imeti are written with incorrect gender and inclination based on the context. Our model corrects them to popravlja and imajo.
Testing the model with generated test sets provides the following result (combining detection and correction of words with incorrect shapes):
Precission: 0,911Recall:0,811F1: 0,858The authors acknowledge the financial support from the Slovenian Research and Innovation Agency - research core funding No. P6-0411: Language Resources and Technologies for Slovene and research project No. J7-3159: Empirical foundations for digitally-supported development of writing skills.
Thanks to Martin Božič, Marko Robnik-Šikonja and Špela Arhar Holdt for developing these models.