Downloads · 30 days
99
3% of all-time downloads
t5-sl-small
cjvt/t5-sl-small
t5-sl-small is a machine learning model from cjvt. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters. It was trained for 5 epochs on the following corpora:
All-time downloads
3.6K
Public
Repo size
923 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin307 MB · 99%
At a glance
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- t5
- Access
- Public
- Created
- Apr 25, 2022
- Updated
- Sep 28, 2022
- SHA
- 614a33f2
Model card
From the Hugging Face model README
t5-sl-small
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters. It was trained for 5 epochs on the following corpora:
Corpora
The following corpora were used for training the model:
- Gigafida 2.0
- Kas 1.0
- Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
- Slovenian parliamentary corpus siParl 2.0
- slWaC
Evaluation
The model is described in detail and evaluated in our paper "Sequence to sequence pretraining for a less-resourced Slovenian language"
Changelog
2022-07-21: updated with v2 of the model, the old one is still accesible at cjvt/legacy-t5-sl-small. 2022-09-21: added fast tokenizer (Huggingface's TokenizerFast class, the tokenization remains the same)
- Library
- transformers
- Type
- t5
- License
- cc-by-sa-4.0
- Languages
- sl
- Created
- Apr 25, 2022
- Updated
- Sep 28, 2022