Downloads · 30 days
9
13% of all-time downloads
Qwen2.5-1.5B-Instruct-MLX-4bit
majentik/Qwen2.5-1.5B-Instruct-MLX-4bit
Qwen2.5-1.5B-Instruct-MLX-4bit is a text generation model from majentik. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
Plain affine 4-bit (group-size 32) MLX quantization of Qwen/Qwen2.5-1.5B-Instruct. This is the baseline sibling of the DWQ pack — for higher quality at the same size and bit-width, use the DWQ variant (perplexity 9.45…
All-time downloads
70
Public
Parameters
1.5B
977 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors965 MB · 99%
Parameter types
How the weights are stored.
U321.5B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-1.5B-Instruct-MLX-4bit
Plain affine 4-bit (group-size 32) MLX quantization of Qwen/Qwen2.5-1.5B-Instruct. This is the baseline sibling of the DWQ pack — for higher quality at the same size and bit-width, use the DWQ variant (perplexity 9.45 vs 9.86 here).
Variants
<!-- sibling-table -->| Variant | Size | Status |
|---|---|---|
| Qwen2.5-1.5B-Instruct-MLX-8bit | 1.5 GB | teacher |
| Qwen2.5-1.5B-Instruct-MLX-4bit | 0.93 GB | this repo — plain affine 4-bit (gs32) |
| Qwen2.5-1.5B-Instruct-MLX-4bit-DWQ | 0.93 GB | DWQ (recommended) |
Reproduce
python -m mlx_lm convert --hf-path Qwen/Qwen2.5-1.5B-Instruct \
--mlx-path Qwen2.5-1.5B-Instruct-MLX-4bit -q --q-bits 4 --q-group-size 32
Group-size 32 per docs/quantization-policy.md rule 1 (doubles tunable
scale/bias params at low bit width).
Usage
pip install mlx-lm
python -m mlx_lm generate --model majentik/Qwen2.5-1.5B-Instruct-MLX-4bit \
--prompt "The capital of France is"
License
Apache-2.0, inherited from the base model Qwen/Qwen2.5-1.5B-Instruct.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen2
- License
- apache-2.0
- Created
- Jul 14, 2026
- Updated
- Jul 14, 2026