Downloads · 30 days
0
kirundi-mt5-translator
eligapris/kirundi-mt5-translator
kirundi-mt5-translator is a machine learning model from eligapris. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.
Access
Public
Updated Dec 6, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json2.1 MB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Dec 6, 2024
- Updated
- Dec 6, 2024
- SHA
- 643c323f
Model card
From the Hugging Face model README
Kirundi-English MT5 Translator with LoRA
This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.
Model Details
- Base Model: google/mt5-small
- LoRA rank: 8
- LoRA alpha: 32
- Target modules: q, v
- Training Data: {len(tokenized_dataset["train"])} examples
- Validation Data: {len(tokenized_dataset["test"])} examples
Training Parameters
- Learning Rate: 2e-5
- Batch Size: 8
- Epochs: 3
- Weight Decay: 0.01
Current Metrics
- BLEU Score: 0.000054
- Library
- transformers
- Created
- Dec 6, 2024
- Updated
- Dec 6, 2024