Downloads · 30 days
38
9% of all-time downloads
Voxtral-Mini-4B-Realtime-8bit-mlx
ellamind/Voxtral-Mini-4B-Realtime-8bit-mlx
Voxtral-Mini-4B-Realtime-8bit-mlx is a automatic speech recognition model from ellamind. Use it when you need speech turned into text. It is set up for mlx. The card lists the license as apache-2.0.
This is an 8-bit quantized MLX version of Voxtral Mini 4B Realtime by Mistral AI, converted using voxmlx.
All-time downloads
407
Public
Parameters
4.4B
4.7 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors4.7 GB · 100%
Parameter types
How the weights are stored.
U324.4B · 100%
Base models
Model card
From the Hugging Face model README
Voxtral Mini 4B Realtime - 8-bit MLX
This is an 8-bit quantized MLX version of Voxtral Mini 4B Realtime by Mistral AI, converted using voxmlx.
This version was created for use with Supervoxtral, enabling blazingly-fast realtime transcription on MacOS.
Model Details
- Base model: mistralai/Voxtral-Mini-4B-Realtime-2602
- Quantization: 8-bit (group size 64)
- Framework: MLX
- Parameters: ~4B (3.4B language model + 970M audio encoder)
- License: Apache 2.0
Description
Voxtral Mini is a speech-to-text model that supports 13+ languages with sub-500ms latency. This version has been quantized to 8-bit precision for efficient inference on Apple Silicon using the MLX framework.
Credits
- Original model by Mistral AI
- MLX conversion tooling by voxmlx
- Task
- Automatic Speech Recognition
- Library
- mlx
- License
- apache-2.0
- Created
- Feb 20, 2026
- Updated
- Feb 20, 2026