Downloads · 30 days
13
3% of all-time downloads
uk-mt5-large
kravchenko/uk-mt5-large
uk-mt5-large is a machine learning model from kravchenko. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
The aim is to compress the mT5-large model to leave only the Ukrainian language and some basic English.
All-time downloads
519
Public
Repo size
6.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin3.1 GB · 100%
At a glance
- Library
- transformers
- Model type
- mt5
- Access
- Public
- Created
- Jun 12, 2022
- Updated
- Jun 12, 2022
- SHA
- 80052b04
Model card
From the Hugging Face model README
The aim is to compress the mT5-large model to leave only the Ukrainian language and some basic English.
Reproduced the similar result (but with another language) from this medium article.
Results:
- 1.2B params -> 779M params (37%)
- 250K tokens -> 8900 tokens
- 4.6GB size model -> 2.9GB size model
- Library
- transformers
- Type
- mt5
- Languages
- uk, en
- Created
- Jun 12, 2022
- Updated
- Jun 12, 2022