Downloads · 30 days
0
Zhxshy/kazakh-asr-ckpts
kazakh-asr-ckpts is a machine learning model from Zhxshy. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
0
Access
Public
Updated Jul 9, 2026
Repo size
3.9 GB
Likes
0
Public
Click a slice to open those files.
.pt3.9 GB · 100%
From the Hugging Face model README
Ablation Study: Learning Rate
Task: Kazakh speech recognition (ASR) Model: Meta omniASR_CTC_300M_v2 (1024-dim, 24 layers, 16 heads) Tokenizer: omniASR_tokenizer_written_v2 (char-level, 10,288 vocab) Data: KSC2 + FLEURS (clean, no augmentation) Optim: AdamW, betas=[0.9, 0.98], weight_decay=0.0 Scheduler: Tri-stage LR
| Run | LR | Steps | Final CTC Loss | Best CTC Loss |
|---|---|---|---|---|
| 2e-5, Run 1 | 2.0e-5 | 30,000 | -9.16 | -9.16 |
| 2e-5, Run 2 | 2.0e-5 | 21,000 | -10.24 | - |
| 1e-5, Run 1 | 1.0e-5 | 27,000 | -11.13 | -11.13 |
| LR | Steps | Path | Size |
|---|---|---|---|
| 2e-5 (Run 1) | 30k | step_30000/model/ | 1.29 GB |
| 2e-5 (Run 2) | 21k | step_21000/model/ | 1 |
| 1e-5 | 27k | step_27000/model/ | 1.29 GB |
| Stage | Ratio | LR |
|---|---|---|
| Warmup | 5% | 0 to LR |
| Constant | 35% | LR |
| Decay | 60% | LR to final_lr |