Downloads · 30 days
14
6% of all-time downloads
QwQ-32b-MLX-AWQ-4bit
Goraint/QwQ-32b-MLX-AWQ-4bit
QwQ-32b-MLX-AWQ-4bit is a text generation model from Goraint. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model is a quantized version of QwQ3-32B converted to AWQ Q4 format using the mlx library for efficient inference. It retains the core capabilities of QwQ 32b while optimizing for resource constraints.
All-time downloads
221
Public
Parameters
32.8B
18.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors18.5 GB · 100%
Parameter types
How the weights are stored.
U3232.8B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
This model is a quantized version of QwQ3-32B converted to AWQ Q4 format using the mlx library for efficient inference. It retains the core capabilities of QwQ 32b while optimizing for resource constraints.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen2
- License
- apache-2.0
- Created
- May 15, 2025
- Updated
- May 15, 2025