Downloads · 30 days
12
3% of all-time downloads
mt5-large-no
norkart/mt5-large-no
mt5-large-no is a machine learning model from norkart. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a pruned version of the model. Here, the input and output embeddings are pruned to support a greatly reduced vocabulary. The chosen vocabulary has 30K norwegian, english and special tokens, ~12% of the old siz…
All-time downloads
422
Public
Parameters
779M
6.2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin3.1 GB · 50%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- mt5
- Access
- Public
- Created
- Aug 2, 2023
- Updated
- Aug 8, 2023
- SHA
- 023e07c5
Try a prompt
Model card
From the Hugging Face model README
This is a pruned version of the google/mt5-large model. Here, the input and output embeddings are pruned to support a greatly reduced vocabulary.
The chosen vocabulary has 30K norwegian, english and special tokens, ~12% of the old size. This reduces the model size by roughly 37%.
The model is still OK on similar languages, like German and Danish, but very different languages like arabic are not a good fit anymore.
This model is intended as a starting point for finetuning mt5 for norwegian applications.
- Library
- transformers
- Type
- mt5
- License
- apache-2.0
- Languages
- no, en
- Created
- Aug 2, 2023
- Updated
- Aug 8, 2023