Downloads · 30 days
0
ai4good-labyrinth/fleurs-trigram-hours0p75-whisper-medium-no-language-lora-adapter
fleurs-trigram-hours0p75-whisper-medium-no-language-lora-adapter is a automatic speech recognition model from ai4good-labyrinth. Use it when you need speech turned into text. The card lists the license as apache-2.0.
This repository contains a Whisper checkpoint for Chichewa/Nyanja automatic speech recognition, fine-tuned from openai/whisper-medium.
Downloads · 30 days
0
Access
Public
Updated May 31, 2026
Repo size
563 MB
Likes
0
Public
Click a slice to open those files.
.safetensors563 MB · 99%
From the Hugging Face model README
This repository contains a Whisper checkpoint for Chichewa/Nyanja
automatic speech recognition, fine-tuned from openai/whisper-medium.
fleurs-trigramopenai/whisper-mediumno_languageThis adapter is intended for research and evaluation on Chichewa/Nyanja ASR. It must be used together with the base Whisper model. It is not a production-ready speech system and should be validated carefully before downstream use.
This repository contains an adapter, not a fully merged standalone model. Load the base model first, then attach the adapter.
from transformers import AutoModelForSpeechSeq2Seq, AutoProcessor
from peft import PeftModel
base_model_id = "openai/whisper-medium"
adapter_repo_id = "ai4good-labyrinth/fleurs-trigram-hours0p75-whisper-medium-no-language-lora-adapter"
processor = AutoProcessor.from_pretrained(base_model_id)
base_model = AutoModelForSpeechSeq2Seq.from_pretrained(base_model_id)
model = PeftModel.from_pretrained(base_model, adapter_repo_id)
The local evaluation script in this repository can also load the adapter
directly because it reads adapter_config.json and automatically fetches the
base model.
FLEURS train + Chichewa Trigrams trainFLEURS dev2211822077311305min_duration_seconds=0.0, max_duration_seconds=30.0experiments/whisper_finetune/finetune_whisper.pyopenai/whisper-mediumtranscribe--language auto in standalone evaluationyes32640.05q_proj,fc1,out_proj,fc2,k_proj,v_projembed_tokens,proj_outfp16TrueTBDTBDThe best checkpoint was selected using trainer-side dev evaluation on the duration-filtered FLEURS dev split.
0.47210.12390.6224These values come from the training pipeline and may differ slightly from standalone post-hoc evaluation because the decoding path is not perfectly identical.
Standalone evaluation is recommended for the final release. Filtered and unfiltered results should be reported separately.
min_duration_seconds=0, max_duration_seconds=30transcribeauto| Dataset | Split | Setting | Num examples | WER | CER | Notes |
|---|---|---|---|---|---|---|
| FLEURS | dev | filtered | 305 | 0.5140 | 0.1261 | Filtered to 30 seconds |
| FLEURS | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
| FLEURS | test | filtered | 745 | 0.4668 | 0.1226 | Filtered to 30 seconds |
| FLEURS | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
| Zambezi | dev | filtered | 613 | 0.8179 | 0.2829 | Filtered to 30 seconds |
| Zambezi | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
| Zambezi | test | filtered | 427 | 0.8890 | 0.3105 | Filtered to 30 seconds |
| Zambezi | test | unfiltered | 428 | 0.8843 | 0.3083 | No duration filter |
eval/...If you use this checkpoint, please cite:
@misc{fleurs_trigram_hours0p75_whisper_medium_no_language_lora_adapter_2026,
title = {FLEURS-Trigram Whisper Medium No-Language LoRA Adapter},
author = {AI4Good Labyrinth Team},
year = {2026},
howpublished = {\url{https://huggingface.co/ai4good-labyrinth/fleurs-trigram-hours0p75-whisper-medium-no-language-lora-adapter}},
note = {Whisper LoRA adapter fine-tuning for Chichewa/Nyanja ASR}
}