mms-ewe-asr-mixed

mms-ewe-asr-mixed — Ewe speech recognition (MMS-1B fine-tune)

Fine-tuned version of facebook/mms-1b-all (Wav2Vec2 / CTC) for automatic speech recognition (ASR) in Ewe (ee, ewe_Latn), a low-resource Gbe language spoken in Togo and Ghana.

Only the language-specific MMS adapter and the CTC head are trained; the model loads with plain Wav2Vec2ForCTC (the Ewe adapter is baked into the weights).

Model details

• Developed by: Romaric Nadjire — academic project (M1 AI, INF2229)
• Task / type: Speech-to-text, Wav2Vec2 CTC (MMS)
• Language: Ewe (ee)
• Fine-tuned from: facebook/mms-1b-all
• License: CC-BY-NC-4.0 (inherited from the base model — non-commercial, academic use)

Intended uses & limitations

• Direct use: transcribing Ewe speech (mono, 16 kHz) to text.
• Out of scope: other languages; far-field / very noisy audio; any commercial use.
• Bias & limitations: training data is dominated by read speech (Bible readings and navigation prompts), so accuracy drops on spontaneous, conversational or dialectal speech. Numbers, code-switching and named entities are error-prone. Reported metrics are on the validation split of the mixed set.

Evaluation

WER = Word Error Rate, CER = Character Error Rate (lower is better). The mixed multi-domain validation set is deliberately harder than a Bible-only test set.

How to get started

import torch, soundfile as sf, soxr
from transformers import AutoProcessor, Wav2Vec2ForCTC

repo = "romaricnadjire/mms-ewe-asr-mixed"
processor = AutoProcessor.from_pretrained(repo)   # tokenizer target_lang="ewe" is baked in
model = Wav2Vec2ForCTC.from_pretrained(repo).eval()

audio, sr = sf.read("audio.wav", dtype="float32")
if audio.ndim == 2:
    audio = audio.mean(axis=1)
if sr != 16000:
    audio = soxr.resample(audio, sr, 16000)

inputs = processor(audio, sampling_rate=16000, return_tensors="pt")
with torch.inference_mode():
    logits = model(inputs.input_values).logits
pred_ids = torch.argmax(logits, dim=-1)
print(processor.batch_decode(pred_ids, skip_special_tokens=True)[0])

Training

• Base: facebook/mms-1b-all (MMS adapter + CTC head trained; ctc_zero_infinity=True).
• Data: a mixed 16 kHz Ewe corpus combining BibleTTS Ewe readings and GhanaNLP navigation-domain speech.
• Setup: 8000 steps, lr 3e-4, effective batch size 32 (4 × 8 grad. accum.), linear schedule, 500 warmup steps, AMP. Trained on Kaggle GPU.

Data sources & attribution

• BibleTTS (Ewe) — BibleTTS, licensed CC-BY-SA 4.0. Attribution required.
• GhanaNLP Ewe speech corpora (navigation / Bible audio).
• Base model MMS (facebook/mms-1b-all) by Meta AI — CC-BY-NC 4.0.

License & citation

This model is a derivative of facebook/mms-1b-all and is released under CC-BY-NC-4.0 (non-commercial). Please credit the base model (Meta MMS) and the data sources above (notably BibleTTS, CC-BY-SA 4.0).

Academic / portfolio project. Not legal advice; verify licenses before any non-research or commercial use.