code-switching-codesaviours-si26-hania

Code-Switching Token Classification Model (Roman Urdu & English)

Model Overview

This model is a fine-tuned XLM-RoBERTa (base) architecture trained to perform word/token-level Language Identification on code-mixed social text containing Roman Urdu and English.

• Developed by: Hania Emaan
• Model Type: Token Classification / Sequence Labeling
• Base Model: xlm-roberta-base
• Languages: Roman Urdu, English

---

Label Scheme & Categories

---

Evaluation Results

The model was evaluated on a held-out test set using token-level precision, recall, and F1-scores via seqeval:

---

How to Get Started

You can load and test this model directly using Hugging Face's pipeline:

from transformers import pipeline

nlp = pipeline(
    "token-classification", 
    model="HaniaEmaan/code-switching-codesaviours-si26-hania", 
    aggregation_strategy="simple"
)

sentence = "aaj mera project submission complete ho gaya hai"
predictions = nlp(sentence)

for pred in predictions:
    print(f"Token: {pred['word']} | Label: {pred['entity_group']} | Score: {pred['score']:.4f}")