Downloads · 30 days
10
20% of all-time downloads
bhaveshsoni0023/parakeet-tdt-0.6b-an4
parakeet-tdt-0.6b-an4 is a automatic speech recognition model from bhaveshsoni0023. Use it when you need speech turned into text. It is set up for nemo. The card lists the license as cc-by-4.0.
This is a fine-tuned version of NVIDIA's nvidia/parakeet-tdt-0.6b-v3 automatic speech recognition (ASR) model, adapted to the AN4 dataset using the NVIDIA NeMo framework.
Downloads · 30 days
10
20% of all-time downloads
All-time downloads
50
Public
Repo size
2.5 GB
Likes
0
Public
Click a slice to open those files.
.nemo2.5 GB · 100%
From the Hugging Face model README
This is a fine-tuned version of NVIDIA's nvidia/parakeet-tdt-0.6b-v3 automatic speech recognition (ASR) model, adapted to the AN4 dataset using the NVIDIA NeMo framework.
The base model is a 600M-parameter FastConformer model with a Token-and-Duration Transducer (TDT) decoder. This fine-tune adapts it to AN4's specific output style — lowercase text, no punctuation, and spelled-out letters and digit strings.
nvidia/parakeet-tdt-0.6b-v3 (FastConformer encoder + TDT decoder)EncDecRNNTBPEModel (RNN-Transducer with BPE tokenization)Intended use. This model is a learning/demonstration artifact showing ASR fine-tuning on a small, domain-specific dataset. It transcribes short English utterances in AN4's style (spelled letters, spoken digits, short commands).
Important limitations — read before using:
nvidia/parakeet-tdt-0.6b-v3 instead.Install NeMo, then load and transcribe with the NeMo toolkit:
```python import nemo.collections.asr as nemo_asr
model = nemo_asr.models.ASRModel.from_pretrained("bhaveshsoni0023/parakeet-tdt-0.6b-an4")
hyps = model.transcribe(["path/to/audio.wav"]) for h in hyps: print(h.text if hasattr(h, "text") else h) ```
Fine-tuned with the `speech_to_text_finetune.py` script from the NeMo Speech repository, warm-started from the pretrained base model (the base tokenizer was kept, i.e. no tokenizer update).
| Setting | Value |
|---|---|
| Base model | `nvidia/parakeet-tdt-0.6b-v3` |
| Dataset | AN4 (train: 948 utts, test: 130 utts) |
| Tokenizer | Reused from base model (no change) |
| Optimizer | AdamW |
| Learning rate | 1e-4 |
| LR schedule | CosineAnnealing, 100 warmup steps |
| Batch size | 16 |
| Epochs | 20 (1200 steps) |
| Precision | bf16 |
| Loss | TDT (Token-and-Duration Transducer) |
| Sample rate | 16 kHz mono |
Best validation WER during training reached ~0.041 (4.1%).
Evaluated on the AN4 test split (130 utterances), Word Error Rate (WER, lower is better):
| Model | Test WER |
|---|---|
| Baseline (`nvidia/parakeet-tdt-0.6b-v3`) | 75.81% |
| Fine-tuned (this model) | 0.39% |
How to read these numbers (important). The large gap is partly real adaptation and partly a scoring artifact. The baseline model outputs punctuation and capitalization and expects natural sentences, so on AN4's bare lowercase spelled-out labels it is penalized heavily by WER even when it recognizes the speech correctly. The fine-tuned model scores far lower mostly because it learned to match AN4's exact output format. A fairer comparison would normalize both hypotheses and references (lowercase, strip punctuation) before scoring, which would raise the baseline substantially and shrink the true gap. The fine-tune does genuinely help, but the headline delta overstates it.
This model is released under CC-BY-4.0, inherited from the base model.
It is a derivative of `nvidia/parakeet-tdt-0.6b-v3` by NVIDIA, which is licensed under CC-BY-4.0. Attribution to NVIDIA is required under the terms of that license. The AN4 dataset is used for training/evaluation.
If you use this model, please also credit the base model and framework: