Downloads · 30 days
21
3% of all-time downloads
Goraint/Qwen3-32B-4bit-AWQ-MLX
Qwen3-32B-4bit-AWQ-MLX is a text generation model from Goraint. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model is a quantized version of Qwen3-32B converted to AWQ Q4 format using the mlx library for efficient inference. It retains the core capabilities of Qwen3 while optimizing for resource constraints.
Downloads · 30 days
21
3% of all-time downloads
All-time downloads
641
Public
Parameters
32.8B
18.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.5 GB · 100%
How the weights are stored.
U3232.8B · 100%
From the Hugging Face model README
This model is a quantized version of Qwen3-32B converted to AWQ Q4 format using the mlx library for efficient inference. It retains the core capabilities of Qwen3 while optimizing for resource constraints.