Downloads · 30 days
20
2% of all-time downloads
est5base
JorgeSarry/est5base
est5base is a machine learning model from JorgeSarry. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is a smaller version of the google/mt5-base model with only Spanish and some English embeddings left following the procedure outlined here https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a…
All-time downloads
1.3K
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin977 MB · 100%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Sep 13, 2021
- SHA
- c6cb2ca4
Model card
From the Hugging Face model README
This is a smaller version of the google/mt5-base model with only Spanish and some English embeddings left following the procedure outlined here https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90
The original model has 582M parameters, with 384M of them being input and output embeddings. After shrinking the sentencepiece vocabulary from 250K to 30K (top 10K English and top 20K Spanish tokens) the number of model parameters reduced to 244M parameters, resulting on a model size reduced from 2.2GB to 0.9GB - 42% of the original one.
- Library
- transformers
- Type
- t5
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Sep 13, 2021