Downloads · 30 days
14
1% of all-time downloads
slovak-t5-small
ApoTro/slovak-t5-small
slovak-t5-small is a machine learning model from ApoTro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This model was trained on slightly adapted code from runt5mlmflax.py. If you want to know about training details or evaluation results, see SlovakT5report.pdf. For evaluation, you can also run SlovakT5eval.ipynb.
All-time downloads
2.1K
Public
Repo size
726 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin242 MB · 50%
At a glance
- Library
- transformers
- License
- mit
- Model type
- t5
- Access
- Public
- Created
- Jun 15, 2022
- Updated
- Jun 16, 2022
- SHA
- 2dbcfc7b
Datasets
Model card
From the Hugging Face model README
SlovakT5-small
This model was trained on slightly adapted code from run_t5_mlm_flax.py. If you want to know about training details or evaluation results, see SlovakT5_report.pdf. For evaluation, you can also run SlovakT5_eval.ipynb.
How to use
SlovakT5-small can be fine-tuned for a lot of different downstream tasks. For example, NER:
from transformers import AutoTokenizer, T5ForConditionalGeneration
tokenizer = AutoTokenizer.from_pretrained("ApoTro/slovak-t5-small")
model = T5ForConditionalGeneration.from_pretrained("ApoTro/slovak-t5-small")
input_ids = tokenizer("ner veta: Do druhého kola postúpili Robert Fico a Andrej Kiska s rozdielom 4,0%.", return_tensors="pt").input_ids
labels = tokenizer("per: Robert Fico | per: Andrej Kiska", return_tensors="pt").input_ids
# the forward function automatically creates the correct decoder_input_ids
loss = model(input_ids=input_ids, labels=labels).loss
loss.item()
- Library
- transformers
- Type
- t5
- License
- mit
- Languages
- sk
- Created
- Jun 15, 2022
- Updated
- Jun 16, 2022