parakeet-unified-en-0.6b-coreml

<span style="color:#5DAF8D">🧃 Parakeet Unified EN 0.6B - CoreML </span>

A CoreML-optimized Parakeet Unified 0.6B English ASR model for Apple platforms. A single FastConformer-RNNT checkpoint serves both offline batch transcription and low-latency streaming, with punctuation and capitalization. The encoder is multi-context trained, so each streaming latency tier is the same weights re-exported with a different chunked-attention mask.

This model is consumed by the FluidAudio Swift SDK.

Model Description

• Architecture: FastConformer encoder + RNNT (Transducer) decoder/joint
• Parameters: ~0.6B
• Language: English
• Sample rate: 16 kHz mono
• Vocabulary: 1024 SentencePiece tokens (blank index 1024)
• Subsampling factor: 8 (one encoder frame ≈ 80 ms)
• Precision: FLOAT16; an INT8 encoder variant is included for higher throughput
• Punctuation & capitalization: yes

The same checkpoint exposes two paths:

• Offline batch — full-attention 15 s windows (240,000 samples), long files transcribed with overlapping windows merged on a 2 s overlap.
• Streaming — a [left, chunk, right] chunked-attention window baked into the encoder at conversion time. Latency = (chunk + right) × 80 ms.

Streaming latency tiers

*Aggregate WER on a 150-file LibriSpeech test-clean sweep (identical files across tiers, so the relative ordering is what matters). Rules of thumb: look-ahead (right context) drives WER, chunk size drives RTFx, and look-ahead saturates around right ≈ 2 frames.

Benchmarks

LibriSpeech test-clean, all 2620 files, INT8 encoder, scored with FluidAudio's TextNormalizer:

vs Parakeet TDT v3 (same harness)

For English transcription, Unified batch beats TDT v3 on both WER and throughput and adds punctuation/capitalization. TDT v3 remains the choice for non-English audio.

Usage in Swift

import FluidAudio

// Offline batch transcription
let manager = try await UnifiedAsrManager.fromHub()
let result = try await manager.transcribe(samples)   // 16 kHz mono Float
print(result.text)

// Streaming (choose a latency tier)
let streaming = try await StreamingUnifiedAsrManager.fromHub(variant: .parakeetUnified2080ms)

The CLI selects a tier with --parakeet-variant, e.g. parakeet-unified-320ms, parakeet-unified-1120ms, parakeet-unified-2080ms (default), or parakeet-unified-offline-15s. See the FluidAudio repository for full instructions.

Repository contents

CoreML pipeline (.mlmodelc), driven from metadata.json / vocab.json:

metadata.json holds the runtime shapes (mel/encoder/decoder/state) and streaming window geometry; vocab.json is the 1024-token SentencePiece vocabulary.

License

Released under the CC-BY-4.0 license.

Acknowledgments

Based on NVIDIA's Parakeet (FastConformer-RNNT) model. CoreML conversion and Swift integration by the FluidInference team.