Downloads · 30 days
30
3% of all-time downloads
nllb-pruned-6L-512d-finetuned
slone/nllb-pruned-6L-512d-finetuned
nllb-pruned-6L-512d-finetuned is a translation model from slone. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
It is a truncated version of NLLB-200-600M model (6 layers instead of 12, 512 hidden dimensions instead of 1024) with 175M parameters (131M of which are token embeddings).
All-time downloads
959
Public
Repo size
1.4 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.bin701 MB · 99%
At a glance
- Task
- Translation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- m2m_100
- Access
- Public
- Created
- Nov 23, 2023
- Updated
- Nov 23, 2023
- SHA
- 09ac636a
Datasets
Model card
From the Hugging Face model README
It is a truncated version of NLLB-200-600M model (6 layers instead of 12, 512 hidden dimensions instead of 1024) with 175M parameters (131M of which are token embeddings).
This model was fine-tuned on the slone/nllb-200-10M-sample subset of the NLLB dataset with 175 languages, using only the samples with BLASER score above 3.5.
Because of its small size, it is really bad at translation, but can serve as a base model for further fine-tuning for a small number of languages. It is recommended to prune the vocabulary of this model before fine-tuning, to preserve only the tokens used with the intended languages.
- Task
- Translation
- Library
- transformers
- Type
- m2m_100
- License
- cc-by-nc-4.0
- Languages
- ak, am, ar, awa, azj, bm
- Created
- Nov 23, 2023
- Updated
- Nov 23, 2023