Downloads · 30 days
12
1% of all-time downloads
Mistral-Small-3.1-24B-Instruct-2503-4bit
OrchardPair/Mistral-Small-3.1-24B-Instruct-2503-4bit
Mistral-Small-3.1-24B-Instruct-2503-4bit is a machine learning model from OrchardPair. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for vllm. The card lists the license as apache-2.0.
This model was converted to MLX format from prince-canuma/Mistral-Small-3.1-24B-Instruct-2503 using mlx-vlm version 0.1.19. Refer to the original model card for more details on the model.
All-time downloads
1.4K
Public
Repo size
14.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.1 GB · 100%
At a glance
- Library
- vllm
- License
- apache-2.0
- Model type
- mistral3
- Access
- Public
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026
- SHA
- d8e95592
Base models
Model card
From the Hugging Face model README
mlx-community/Mistral-Small-3.1-24B-Instruct-2503-4bit
This model was converted to MLX format from prince-canuma/Mistral-Small-3.1-24B-Instruct-2503 using mlx-vlm version 0.1.19.
Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/Mistral-Small-3.1-24B-Instruct-2503-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
- Library
- vllm
- Type
- mistral3
- License
- apache-2.0
- Languages
- en, fr, de, es, pt, it
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026