Downloads · 30 days
0
parakeet-GGUF
ggml-org/parakeet-GGUF
parakeet-GGUF is a machine learning model from ggml-org. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
GGUF conversions of nvidia/parakeet-tdt-0.6b-v3 for use with whisper.cpp.
Access
Public
Updated Jun 16, 2026
Repo size
5.2 GB
Likes
11
Public
Repo makeup
Click a slice to open those files.
.bin5.2 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 16, 2026
- Updated
- Jun 16, 2026
- SHA
- 35156454
Base models
Model card
From the Hugging Face model README
Parakeet TDT 0.6B v3 (GGUF)
GGUF conversions of nvidia/parakeet-tdt-0.6b-v3 for use with whisper.cpp.
Available files
ggml-parakeet-tdt-0.6b-v3-f32.bin— Full precision (F32)ggml-parakeet-tdt-0.6b-v3-f16.bin— Half precision (F16)ggml-parakeet-tdt-0.6b-v3-q8_0.bin— 8-bit quantized (Q8_0)ggml-parakeet-tdt-0.6b-v3-q4_0.bin— 4-bit quantized (Q4_0)ggml-parakeet-tdt-0.6b-v3-q4_k.bin— 4-bit K-quantized (Q4_k)
Usage
Build parakeet-cli:
git clone https://github.com/ggml-org/whisper.cpp.git
cd whisper.cpp
cmake -B build -S .
cmake --build build --target parakeet-cli -j $(nproc)
Download a model (e.g. Q8_0):
hf download ggml-org/parakeet-GGUF ggml-parakeet-tdt-0.6b-v3-q8_0.bin --local-dir models
Run:
./build/bin/parakeet-cli -m models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f samples/jfk.wav
- License
- mit
- Created
- Jun 16, 2026
- Updated
- Jun 16, 2026