me-lid-bert

l3cube-pune/me-lid-bert

me-lid-bert is a token classification model from l3cube-pune. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-4.0.

MeLID-BERT is a MeBERT-Mixed-v2 model fine-tuned on L3Cube-MeLID, a codemixed Marathi-English language identification dataset. <br [dataset link] (https://github.com/l3cube-pune/MarathiNLP)

Downloads · 30 days

0% of all-time downloads

All-time downloads

4.3K

Public

Parameters

237M

1.9 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin948 MB · 50%

Parameter types

How the weights are stored.

F32237M · 100%

Datasets

Model card

From the Hugging Face model README

MeLID-BERT

MeLID-BERT is a MeBERT-Mixed-v2 model fine-tuned on L3Cube-MeLID, a codemixed Marathi-English language identification dataset. [dataset link] (https://github.com/l3cube-pune/MarathiNLP)

More details on the dataset, models, and baseline results can be found in our [paper] (https://arxiv.org/abs/2306.14030)

Other models from the MeBERT family: <a href="https://huggingface.co/l3cube-pune/me-bert"> MeBERT </a> <a href="https://huggingface.co/l3cube-pune/me-roberta"> MeRoBERTa </a>

<a href="https://huggingface.co/l3cube-pune/me-bert-mixed"> MeBERT-Mixed </a> <a href="https://huggingface.co/l3cube-pune/me-bert-mixed-v2"> MeBERT-Mixed-v2 </a> <a href="https://huggingface.co/l3cube-pune/me-roberta-mixed"> MeRoBERTa-Mixed </a>

<a href="https://huggingface.co/l3cube-pune/me-lid-roberta"> MeLID-RoBERTa </a> <a href="https://huggingface.co/l3cube-pune/me-hate-roberta"> MeHate-RoBERTa </a> <a href="https://huggingface.co/l3cube-pune/me-sent-roberta"> MeSent-RoBERTa </a> <a href="https://huggingface.co/l3cube-pune/me-hate-bert"> MeHate-BERT </a> <a href="https://huggingface.co/l3cube-pune/me-lid-bert"> MeLID-BERT </a>

Citing:

@article{chavan2023my,
  title={My Boli: Code-mixed Marathi-English Corpora, Pretrained Language Models and Evaluation Benchmarks},
  author={Chavan, Tanmay and Gokhale, Omkar and Kane, Aditya and Patankar, Shantanu and Joshi, Raviraj},
  journal={arXiv preprint arXiv:2306.14030},
  year={2023}
}

Task: Token Classification
Library: transformers
Type: bert
License: cc-by-4.0
Languages: mr, en, multilingual
Created: Jul 16, 2023
Updated: Jul 22, 2023