Downloads · 30 days
12
3% of all-time downloads
meowyboi/mbart-large-50-en-cbk-finetuned
mbart-large-50-en-cbk-finetuned is a translation model from meowyboi. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as apache-2.0.
This model is mbart-large-50-many-to-many-mmt model fine-tuned on English to Zamboanga Chavacano sentences from our own corpus. Chavacano is a Spanish creole, and Zamboanga Chavacano is the most widely spoken Chavacan…
Downloads · 30 days
12
3% of all-time downloads
All-time downloads
345
Public
Parameters
611M
2.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors2.4 GB · 99%
From the Hugging Face model README
This model is mbart-large-50-many-to-many-mmt model fine-tuned on English to Zamboanga Chavacano sentences from our own corpus.
Chavacano is a Spanish creole, and Zamboanga Chavacano is the most widely spoken Chavacano variety in the Philippines.
This translation model aims to leverage the relatedness of Chavacano to Spanish, Tagalog, and other Romance languages through transfer learning to create an English-Zamboanga Chavacano translation model.
The training set contains 5203 sentence, validation set contains 650 sentences, while test set contains 651 sentences. Each sentence is composed of 2-20 words.
The BLEU score of this model on the validation set is 36.37 and 37.74 on the test set.
batch_size = 16
num_train_epochs = 4
learning_rate=2e-4
gradient_accumulation_steps=4
weight_decay=0.01
warmup_steps=500
adam_epsilon=1e-8
max_grad_norm=1.0
fp16=True