Downloads · 30 days
50
7% of all-time downloads
Qwen3-32B-3bit
mlx-community/Qwen3-32B-3bit
Qwen3-32B-3bit is a machine learning model from mlx-community. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This model is a 3-bit quantized version of Qwen/Qwen3-32B using MLX.
All-time downloads
676
Public
Parameters
32.8B
14.3 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors14.3 GB · 100%
Parameter types
How the weights are stored.
U3232.8B · 100%
Base models
Model card
From the Hugging Face model README
Qwen3-32B 3bit MLX
This model is a 3-bit quantized version of Qwen/Qwen3-32B using MLX.
Model Details
- Quantization: 3-bit
- Framework: MLX
- Base Model: Qwen/Qwen3-32B
- Model Size: ~12GB (3-bit quantized)
Usage
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Qwen3-32B-3bit")
prompt = "Hello, how are you?"
messages = [{"role": "user", "content": prompt}]
formatted_prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
response = generate(model, tokenizer, prompt=formatted_prompt, max_tokens=100)
print(response)
Requirements
- Apple Silicon Mac (M1/M2/M3)
- macOS 13.0+
- Python 3.8+
- MLX and mlx-lm packages
Installation
pip install mlx mlx-lm
- Library
- mlx
- Type
- qwen3
- License
- apache-2.0
- Created
- Jul 1, 2025
- Updated
- Jul 1, 2025