Downloads · 30 days
0
danbev/parakeet-GGUF
parakeet-GGUF is a machine learning model from danbev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
GGUF conversions of nvidia/parakeet-tdt-0.6b-v3 for use with whisper.cpp.
Downloads · 30 days
0
Access
Public
Updated Jun 16, 2026
Repo size
12.8 GB
Likes
0
Public
Click a slice to open those files.
.bin5.2 GB · 100%
From the Hugging Face model README
GGUF conversions of nvidia/parakeet-tdt-0.6b-v3 for use with whisper.cpp.
ggml-parakeet-tdt-0.6b-v3-f32.bin — Full precision (F32)ggml-parakeet-tdt-0.6b-v3-f16.bin — Half precision (F16)ggml-parakeet-tdt-0.6b-v3-q8_0.bin — 8-bit quantized (Q8_0)ggml-parakeet-tdt-0.6b-v3-q4_0.bin — 4-bit quantized (Q4_0)ggml-parakeet-tdt-0.6b-v3-q4_k.bin — 4-bit K-quantized (Q4_k)Build parakeet-cli:
git clone https://github.com/ggml-org/whisper.cpp.git
cd whisper.cpp
cmake -B build -S .
cmake --build build --target parakeet-cli -j $(nproc)
Download a model (e.g. Q8_0):
hf download danbev/parakeet-GGUF ggml-parakeet-tdt-0.6b-v3-q8_0.bin --local-dir models
Run:
./build/bin/parakeet-cli -m models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f samples/jfk.wav