yoruba-en-ner-model-small

Yoruba-English Code-Switching Language Identification (LID) - Mini

This model is a highly efficient, fine-tuned version of Davlan/afro-xlmr-mini designed for token-level Language Identification (LID) in Yoruba-English code-switched text.

Research Highlights

• High Accuracy, Low Footprint: Achieved an Overall F1-score of 99.05%, matching the performance of "Large" models (550M parameters) while using a significantly smaller architecture (approx. 17M parameters).
• Efficiency: Optimized for deployment in resource-constrained environments or high-throughput real-time applications.
• African Language Focus: Built upon the AfroXLM-R-Mini base, leveraging pre-training specifically tailored for African linguistic structures.

Performance Evaluation (Test Set)

The following results were obtained on the held-out test set (~80k tokens):

Evaluation Metrics

• Overall Accuracy: 99.56%
• Evaluation Loss: 0.0947

Model Comparison (Ablation Study)

In our research, we compared this "Mini" architecture against a "Large" baseline to evaluate the trade-off between size and accuracy:

Training Procedure

Training Narrative

The model was trained for 5 epochs on an A100 GPU. We utilized a large global batch size (256) and mixed-precision training (BF16) to ensure stable and fast convergence. Unlike larger models that may overfit rapidly on LID tasks, the Mini architecture showed a healthy learning curve with validation loss steadily decreasing throughout the process.

Hyperparameters

• Learning Rate: 3e-05
• Global Batch Size: 256
• Optimizer: AdamW (Fused)
• LR Scheduler: Cosine Decay
• Warmup Ratio: 0.1

Training Logs

Usage

from transformers import pipeline

# Load the model directly from the Hub
lid_model = pipeline("token-classification", model="Professor/yoruba-en-ner-model-small")

text = "Ẹ jẹ́ kí á lọ si cinema to watch the latest movie."
results = lid_model(text)

for entity in results:
    print(f"Token: {entity['word']}, Language: {entity['entity']}")

Intended Uses & Limitations

This model is intended for researchers and developers working on bilingual text processing for Nigerian English and Yoruba. While highly accurate, users should note that performance may vary on text with non-standard orthography or code-switching involving third languages (e.g., Nigerian Pidgin).

Citation

If you use this model in your research, please cite the original AfroXLM-R paper and this specific fine-tuned release.