Downloads · 30 days
1.8K
17% of all-time downloads
mlx-community/Mistral-Small-4-119B-2603-4bit
Mistral-Small-4-119B-2603-4bit is a machine learning model from mlx-community. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This model was converted to MLX format from mistralai/Mistral-Small-4-119B-2603 using mlx-vlm version 0.4.0. Refer to the original model card for more details on the model.
Downloads · 30 days
1.8K
17% of all-time downloads
All-time downloads
10.3K
Public
Parameters
119B
136 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors67.8 GB · 100%
How the weights are stored.
U32119B · 100%
From the Hugging Face model README
This model was converted to MLX format from mistralai/Mistral-Small-4-119B-2603 using mlx-vlm version 0.4.0.
Refer to the original model card for more details on the model.
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/Mistral-Small-4-119B-2603-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>