Downloads · 30 days
40
3% of all-time downloads
uk-mt5-small
kravchenko/uk-mt5-small
uk-mt5-small is a machine learning model from kravchenko. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
The aim is to compress the mT5-small model to leave only the Ukrainian language and some basic English.
All-time downloads
1.3K
Public
Repo size
599 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin299 MB · 100%
At a glance
- Library
- transformers
- Model type
- mt5
- Access
- Public
- Created
- Jun 12, 2022
- Updated
- Jun 12, 2022
- SHA
- c6e5202f
Model card
From the Hugging Face model README
The aim is to compress the mT5-small model to leave only the Ukrainian language and some basic English.
Reproduced the similar result (but with another language) from this medium article.
Results:
- 300M params -> 75M params (75%)
- 250K tokens -> 8900 tokens
- 1.1GB size model -> 0.3GB size model
- Library
- transformers
- Type
- mt5
- Languages
- uk, en
- Created
- Jun 12, 2022
- Updated
- Jun 12, 2022