Downloads · 30 days
13
42% of all-time downloads
Professor/yecs-asr-ctc-300m
yecs-asr-ctc-300m is a automatic speech recognition model from Professor. Use it when you need speech turned into text. It is set up for fairseq2. The card lists the license as other.
Finetune of omniASRCTC300M (Meta Omnilingual ASR) on the Yoruba-English Code-Switching (YECS) Corpus.
Downloads · 30 days
13
42% of all-time downloads
All-time downloads
31
Public
Repo size
2.6 GB
Likes
0
Public
Click a slice to open those files.
.pt1.3 GB · 100%
From the Hugging Face model README
Finetune of omniASR_CTC_300M (Meta Omnilingual ASR) on the Yoruba-English Code-Switching (YECS) Corpus.
This is a fairseq2 checkpoint, not a
transformersmodel. Load it with theomnilingual_asrlibrary (below), NOTAutoModel.from_pretrained.
model.pt — finetuned weights (state dict)omniASR_tokenizer_v1.model — char tokenizer (also auto-downloadable by name)model.yaml, config.yaml — architecture + training configgit clone https://github.com/facebookresearch/omnilingual-asr && cd omnilingual-asr
pip install -e . && pip install huggingface_hub
import re, torch
from huggingface_hub import hf_hub_download
from fairseq2.models.hub import load_model
from fairseq2.data.tokenizers.hub import load_tokenizer
from omnilingual_asr.models.inference.pipeline import ASRInferencePipeline
model = load_model("omniASR_CTC_300M", dtype=torch.bfloat16)
sd = torch.load(hf_hub_download("Professor/yecs-asr-ctc-300m", "model.pt"), map_location="cpu")
model.load_state_dict(sd, strict=False) # if this errors, try sd["model"]
tok = load_tokenizer("omniASR_tokenizer_v1")
pipe = ASRInferencePipeline(None, model=model, tokenizer=tok)
def clean_pred(t): # the ASR tokenizer has no punctuation, so it
return re.sub(r"\s+", " ", t.replace("\u2047", "")).strip() # emits an unknown token (U+2047)
preds = pipe.transcribe(["sample.wav"]) # 16kHz mono; CTC ignores lang
print([clean_pred(p) for p in preds])
Output is lowercase and unpunctuated — that is normal for ASR (the tokenizer models only spoken characters + tone marks, not casing or punctuation).
Training data is NOODL-1.0 (YECS / LyngualLabs) — review its terms before redistribution. Base model omniASR_CTC_300M is Apache-2.0.