Downloads · 30 days
32
3% of all-time downloads
uk-mt5-base
kravchenko/uk-mt5-base
uk-mt5-base is a machine learning model from kravchenko. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
The aim is to compress the mT5-base model to leave only the Ukrainian language and some basic English.
All-time downloads
1K
Public
Repo size
2 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin977 MB · 100%
At a glance
- Library
- transformers
- Model type
- mt5
- Access
- Public
- Created
- May 3, 2022
- Updated
- Jun 12, 2022
- SHA
- 9331e4e6
Model card
From the Hugging Face model README
The aim is to compress the mT5-base model to leave only the Ukrainian language and some basic English.
Reproduced the similar result (but with another language) from this medium article.
Results:
- 582M params -> 244M params (58%)
- 250K tokens -> 30K tokens
- 2.2GB size model -> 0.95GB size model
- Library
- transformers
- Type
- mt5
- Languages
- uk, en
- Created
- May 3, 2022
- Updated
- Jun 12, 2022