Parakeet-TDT-v3-CoreML-INT8

Parakeet TDT v3 — CoreML INT8

CoreML conversion of NVIDIA Parakeet-TDT 0.6B v2 with INT8-quantized encoder for Apple Neural Engine acceleration.

Models

Additional Files

Notes

• INT8 vs INT4: INT8 uses 8-bit palettization for the encoder, offering higher accuracy than INT4 at the cost of ~2x encoder weight size.
• Mel preprocessing is done in Swift using Accelerate/vDSP (not CoreML) because torch.stft tracing bakes audio length as a constant, breaking per-feature normalization for variable-length inputs.
• Encoder uses EnumeratedShapes (100–3000 mel frames, covering 1–30s audio) to avoid BNNS crashes with dynamic shapes.

Usage

Used by speech-swift ParakeetASR module:

let model = try await ParakeetASRModel.fromPretrained(modelId: ParakeetASRModel.int8ModelId)
let text = try model.transcribeAudio(samples, sampleRate: 16000)

---

---

• Guide: soniqo.audio/guides/parakeet
• Docs: soniqo.audio
• GitHub: soniqo/speech-swift