Downloads · 30 days
10
16% of all-time downloads
abhishek2475/mb-Hindi-to-manipuri
mb-Hindi-to-manipuri is a machine learning model from abhishek2475. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This Hindi-to-Manipuri (Bengali script) translation model is built on the foundation of the facebook/mbart-large-50-many-to-many-mmt model, a powerful multilingual machine translation model. It has been fine-tuned spe…
Downloads · 30 days
10
16% of all-time downloads
All-time downloads
63
Public
Parameters
611M
7.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.pt4.9 GB · 66%
From the Hugging Face model README
This Hindi-to-Manipuri (Bengali script) translation model is built on the foundation of the facebook/mbart-large-50-many-to-many-mmt model, a powerful multilingual machine translation model. It has been fine-tuned specifically to handle translation tasks between Hindi and Manipuri, with a focus on generating accurate and contextually appropriate translations in the Bengali script of Manipuri. This model aims to serve users who require reliable and efficient translations between these languages, making it especially valuable for linguistic research, educational content, and cross-cultural communication.
mbart-large-50-many-to-many-mmtUsing pipeline
from transformers import pipeline
pipe = pipeline("text2text-generation", model="abhishek2475/mb-Hindi-to-manipuri")
Load Model Directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("abhishek2475/mb-Hindi-to-manipuri")
model = AutoModelForSeq2SeqLM.from_pretrained("abhishek2475/mb-Hindi-to-manipuri")
The model was finetuned on the abhishek2475/hi-mni-dataset , which contains :
You can export the current file by clicking Export to disk in the menu. You can choose to export the file as plain Markdown, as HTML using a Handlebars template or as a PDF.
The model was evaluated using the BLEU score, with the following :
BLEU Score: 9.10 Limited by hardware resources, training set size, and vocabulary definition, leading to a relatively low BLEU score.
The whole system was implemented on a Corpus Management Tool
Strengths
The Hindi-to-Manipuri (Bengali script) translation model offers a significant step forward in addressing the linguistic gap between these two languages. By fine-tuning the facebook/mbart-large-50-many-to-many-mmt model, this project demonstrates how advanced multilingual models can be adapted to perform specialized translation tasks with improved accuracy and fluency. The model has the potential to support applications in education, digital content creation, and cross-linguistic communication, contributing to the preservation and accessibility of Manipuri language content in the Bengali script.
Future Work
Dataset Expansion: Including larger and more diverse datasets from various domains such as literature, news, and social media could improve the model's ability to handle complex and domain-specific translations.
Support for Additional Scripts: While this model focuses on the Bengali script for Manipuri, adding support for other scripts like Meitei Mayek can broaden its usability and impact.
Fine-Tuning on More Language Pairs: Extending the model's capabilities to handle translations between Hindi and other regional languages, or between Manipuri and other Indian languages, could make it a more versatile tool.