Downloads · 30 days
15
3% of all-time downloads
cjvt/muril-en-hi-codemixed
muril-en-hi-codemixed is a fill-mask model from cjvt. Use it when you need the model to fill a missing word. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
15
3% of all-time downloads
All-time downloads
527
Public
Repo size
234 MB
Likes
0
Public
Click a slice to open those files.
.bin234 MB · 99%
From the Hugging Face model README
muril-en-hi-codemixed is a masked language model, based on the MuRIL multilingual model.
muril-en-hi-codemixed replaces the tokenizer, vocabulary and the embeddings layer of the MuRIL model. The tokenizer and vocabulary used are the same as in the roberta-en-hi-codemixed model. The new embedding weights were initialized from the MuRIL embeddings.
The new muril-en-hi-codemixed model was further pre-trained for two epochs on the same codemixed English and Hindi corpora as the roberta-en-hi-codemixed model.