Downloads · 30 days
22
2% of all-time downloads
sdkv2/ministral-3-3b-reasoning-mlx-q8
ministral-3-3b-reasoning-mlx-q8 is a text generation model from sdkv2. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
Q8-quantized MLX variant of sdkv2/ministral-3-3b-reasoning-mlx (itself a conversion of mistralai/Ministral-3-3B-Reasoning-2512, Apache-2.0).
Downloads · 30 days
22
2% of all-time downloads
All-time downloads
1K
Public
Parameters
3.4B
3.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.6 GB · 100%
How the weights are stored.
U323.4B · 100%
From the Hugging Face model README
Q8-quantized MLX variant of sdkv2/ministral-3-3b-reasoning-mlx
(itself a conversion of mistralai/Ministral-3-3B-Reasoning-2512, Apache-2.0).
Used for the longer repetition runs in the multiheadtest project where the bf16 6.4 GB model would be too slow / memory-bound on the M4 (16 GB).