mms-300m-fongbe

mms-300m-fongbe

This model is a fine-tuned version of facebook/mms-300m specifically for Fongbe (Fon), a tonal language primarily spoken in Benin.

It was developed to preserve linguistic integrity by maintaining critical tonal diacritics and unique orthographic characters (e.g., ɖ, ɛ, ɔ, è, é). This model achieves State-of-the-Art (SOTA) results for Fongbe Automatic Speech Recognition (ASR) on the ALFFA test benchmark.

📊 Evaluation Results

The model was evaluated on the held-out ALFFA test set (2,168 utterances):

Benchmark Comparison (with diacritics)

Inference Examples

📖 Model Description

• Architecture: MMS (Massive Multilingual Speech) 300M parameter model.
• Methodology: Fine-tuned with Connectionist Temporal Classification (CTC) loss.
• Language: Fongbe (fon).
• Phonetic Representation: Tone-preserved orthography using NFD/NFC normalization.
• Special Features: Full support for Fon-specific characters (ɖ, ɛ, ɔ) and tone markers.

🚀 How to Use

from transformers import pipeline

asr = pipeline("automatic-speech-recognition", model="Professor/mms-300m-fongbe")

# Ensure your audio is 16kHz
transcription = asr("path_to_audio.wav")
print(transcription["text"])

🎯 Intended Uses & Limitations

Intended Uses

• High-accuracy transcription of Fongbe speech.
• Research in low-resource and tonal language modeling.
• Base model for downstream Fongbe NLP tasks (NLP4Fon).

Limitations

• Performance may degrade in noisy environments or with heavy background music.
• Primarily trained on continuous speech; may require further fine-tuning for specific dialects or extremely fast colloquial speech.

📁 Training and Evaluation Data

The model was trained on a consolidated dataset merging the ALFFA Project (African Languages in the Field) data and the Zenodo Fongbe Speech Dataset:

• Train + Validation Set: ~10.85 hours (Merged and re-split 90/10).
• Test Set: ~1.45 hours (Standard 2,168 utterances from ALFFA for benchmark consistency).
• Sampling Rate: 16,000 Hz.

⚙️ Training Procedure

Hyperparameters

• Learning Rate: 1e-4
• Effective Batch Size: 64 (Batch 16 x 4 Grad Accumulation)
• Optimizer: AdamW (Fused)
• Epochs: 30
• Precision: Mixed Precision (FP16)
• Hardware: NVIDIA H100 GPU

Training Logs

📜 Citation & Credits

If you use this model in your research, please cite the following:

Dataset Contributors: Laleye, Fréjus A. A., et al. (ALFFA Project & Zenodo release).

Model Developer: Victor Olufemi (Professor).

@dataset{laleye_frejus_2022_6604637,
  author       = {Laleye, Fréjus A. A.},
  title        = {Fongbe Speech Dataset},
  year         = 2022,
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.6604637}
}

@inproceedings{laleye2016FongbeASR,       
    title={First Automatic Fongbe Continuous Speech Recognition System},     
    author={A. A Laleye, Fréjus and Besacier, Laurent and Ezin, Eugène C. and Motamed, Cina},     
    year={2016},     
    organization={FedCSIS}
}