Downloads · 30 days
27
5% of all-time downloads
byt5-basque
monsoon-nlp/byt5-basque
byt5-basque is a machine learning model from monsoon-nlp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Pretrained from scratch on Euskara (Basque language) with ByT5, Google's new byte-level tokenizer strategy.
All-time downloads
572
Public
Parameters
300M
3.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h51.2 GB · 33%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Feb 24, 2025
- SHA
- 581fb92b
Model card
From the Hugging Face model README
byt5-basque
Pretrained from scratch on Euskara (Basque language) with ByT5, Google's new byte-level tokenizer strategy.
Corpus: eu.wikipedia.org as of March 2020 (TFDS)
Pretraining Notebook: https://colab.research.google.com/drive/19Afq7CI6cOi1DaTpnQhBbEbnBzLSFHbH
Todos
Fine-tuning
The Wikipedia corpus is small for this language compared to web crawls. In the future I would add OSCAR, if I can rewrite the script to accept those as one TFDS dataset.
- Library
- transformers
- Type
- t5
- Languages
- eu
- Created
- Mar 2, 2022
- Updated
- Feb 24, 2025