Downloads · 30 days
17
11% of all-time downloads
parakeet-tdt-0.6b-v2-int8
sonic-speech/parakeet-tdt-0.6b-v2-int8
parakeet-tdt-0.6b-v2-int8 is a automatic speech recognition model from sonic-speech. Use it when you need speech turned into text. It is set up for mlx. The card lists the license as cc-by-4.0.
Mixed-precision variant: encoder quantized to INT8, decoder + joint network remain BF16. Optimized for Apple Silicon with reduced memory footprint.
All-time downloads
155
Public
Parameters
618M
737 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors736 MB · 100%
Parameter types
How the weights are stored.
U32533M · 86%
Base models
Model card
From the Hugging Face model README
Parakeet TDT 0.6B V2 (MLX, Encoder INT8)
Mixed-precision variant: encoder quantized to INT8, decoder + joint network remain BF16. Optimized for Apple Silicon with reduced memory footprint.
| Metric | BF16 Reference | This (INT8) |
|---|---|---|
| Peak memory | ~3GB | ~1.5GB |
| Weight size | ~1.2GB | ~660MB |
| WER impact | baseline | +0.1-0.2% expected |
Usage
from parakeet import from_pretrained
model = from_pretrained("sonic-speech/parakeet-tdt-0.6b-v2-int8")
result = model.transcribe("audio.wav")
Quantization Details
- Encoder: INT8, group_size=64
- Decoder (PredictNetwork): BF16 (accuracy-critical)
- Joint network: BF16 (accuracy-critical)
- Method: Post-training quantization via
mlx.nn.quantize - Source:
sonic-speech/parakeet-tdt-0.6b-v2
- Task
- Automatic Speech Recognition
- Library
- mlx
- License
- cc-by-4.0
- Languages
- en
- Created
- Mar 8, 2026
- Updated
- Mar 8, 2026