Downloads · 30 days
0
ik/speechless-twi-stage1-rvq-whisper-medium
speechless-twi-stage1-rvq-whisper-medium is a machine learning model from ik. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as apache-2.0.
Trained RVQ that discretizes Whisper encoder features into semantic tokens for Twi/Akan.
Downloads · 30 days
0
Access
Public
Updated Sep 2, 2025
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.pt1.1 GB · 99%
From the Hugging Face model README
Trained RVQ that discretizes Whisper encoder features into semantic tokens for Twi/Akan.
rvq_final.pt — state dictconfig_stage1.json — training/config paramsrvq_wrapper.py — tiny module defining RVQWrapperimport torch, json
from huggingface_hub import hf_hub_download
from rvq_wrapper import RVQWrapper
cfg = json.load(open(hf_hub_download("ik/speechless-twi-stage1-rvq-whisper-medium", "config_stage1.json"), "r"))
ckpt = torch.load(hf_hub_download("ik/speechless-twi-stage1-rvq-whisper-medium", "rvq_final.pt"), map_location="cpu")
rvq = RVQWrapper(cfg["rvq_dim"], cfg["rvq_num_quantizers"], cfg["rvq_codebook_size"])
rvq.load_state_dict(ckpt["rvq"])
rvq.eval()