SALAMA_SM_ASR

🗣️ SALAMA-STT — Swahili Whisper ASR Model

Developer: AI4NNOV
Authors: AI4NNOV.
Version: v1.0
License: Apache 2.0
Model Type: Automatic Speech Recognition (ASR)
Base Model: openai/whisper-small (fine-tuned for Swahili)

---

🌍 Overview

SALAMA-STT (Speech-to-Text) is the first module of the SALAMA Framework — a modular end-to-end speech-to-speech AI system built for African languages.
This model is fine-tuned from OpenAI’s Whisper-small architecture for Swahili speech recognition, enhancing performance on African accents and conversational data.

The model converts Swahili audio input into accurate transcriptions and serves as the entry point for downstream LLM and TTS modules.

---

🧱 Model Architecture

SALAMA-STT leverages the Whisper-small architecture with a transformer encoder-decoder optimized for low-resource Swahili audio transcription tasks.
The model was fine-tuned on the Mozilla Common Voice 17.0 Swahili dataset, ensuring robustness to diverse accents and speech clarity.

---

📚 Dataset

---

🧠 Model Capabilities

• Speech-to-text transcription in Swahili
• Recognition of African-accented Swahili
• Handles short and long-form audio
• Supports integration with SALAMA-LLM for full voice assistants
• Provides timestamped segment transcriptions

---

📊 Evaluation Metrics

Evaluation conducted on a 2-hour held-out Swahili validation set from Common Voice.

---

⚙️ Usage (Python Example)

Below is a quick example for Swahili speech transcription using this model:

from transformers import pipeline

# Load Swahili Whisper ASR
asr_pipeline = pipeline(
    "automatic-speech-recognition",
    model="EYEDOL/salama-stt",
    chunk_length_s=30,
    device_map="auto"
)

# Example audio file (replace with your file)
audio_path = "swahili_audio_sample.wav"

# Transcribe audio
result = asr_pipeline(audio_path)

print("🗣️ Transcription:")
print(result["text"])

Example Output:

“Karibu kwenye mfumo wa SALAMA unaosaidia kutambua na kuelewa sauti ya Kiswahili kwa usahihi mkubwa.”

---

🔍 Model Performance Summary

---

⚡ Key Features

• 🎙️ Accurate Swahili ASR trained on diverse voices
• 🌍 Adapted for African speech variations and dialects
• 🧩 Lightweight and compatible with SALAMA-LLM
• 🔊 Handles long-form recordings (≥30s)
• 🚀 Fast inference optimized with FP16 precision

---

🚫 Limitations

• May misinterpret code-mixed (Swahili-English) speech
• Background noise and poor microphone quality reduce accuracy
• Domain-specific (medical/legal) terms may be transcribed inaccurately
• Performance may decline on non-native Swahili speakers

---

🔗 Related Models