Downloads · 30 days
177
4% of all-time downloads
huggingface-lc/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit-mxfp4
Qwen3-Coder-30B-A3B-Instruct-MLX-4bit-mxfp4 is a text generation model from huggingface-lc. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model is an MLX-converted version of Qwen/Qwen3-Coder-30B-A3B-Instruct, using mlxlm version 0.28.2, optimized for Apple Silicon. It uses 4-bit quantization with the following settings: - Quantization: 4-bit with…
Downloads · 30 days
177
4% of all-time downloads
All-time downloads
4.9K
Public
Parameters
30.5B
16.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.2 GB · 100%
How the weights are stored.
U3230.5B · 100%
From the Hugging Face model README
This model is an MLX-converted version of Qwen/Qwen3-Coder-30B-A3B-Instruct, using mlx_lm version 0.28.2, optimized for Apple Silicon. It uses 4-bit quantization with the following settings:
--q-mode mxfp4 for efficient performance on Apple Silicon.--q-group-size 32) for improved precision with moderate memory usage (~22-27 GB).mlx_lm.convert \
--hf-path Qwen/Qwen3-Coder-30B-A3B-Instruct \
-q \
--q-bits 4 \
--q-mode mxfp4 \
--q-group-size 32 \
--mlx-path ./qwen3-coder-30b-mlx