Whisper-Large-V3-Turbo-MLX-FP16

Whisper Large V3 Turbo - MLX FP16

This is the OpenAI Whisper Large V3 Turbo model converted to MLX format with FP16 precision, optimized for Apple Silicon inference.

Whisper Large V3 Turbo is a distilled version of Whisper Large V3 that uses only 4 decoder layers instead of 32, making it significantly faster while maintaining high accuracy.

Model Details

Intended Use

This model is optimized for on-device automatic speech recognition (ASR) on Apple Silicon devices (Mac, iPhone, iPad). It is designed for use with the WhisperKit or MLX frameworks.

The Turbo variant offers the best speed/accuracy trade-off for real-time transcription on device.

Files

• config.json - Model configuration
• model.safetensors - Model weights in SafeTensors format (FP16)
• multilingual.tiktoken - Tokenizer

Usage

import mlx_whisper

result = mlx_whisper.transcribe(
    "audio.mp3",
    path_or_hf_repo="aitytech/Whisper-Large-V3-Turbo-MLX-FP16",
)
print(result["text"])

Original Model

• Paper: Robust Speech Recognition via Large-Scale Weak Supervision
• Authors: OpenAI
• License: MIT