Downloads · 30 days
12
18% of all-time downloads
Qwen2.5-1.5B-Instruct-MLX-8bit
majentik/Qwen2.5-1.5B-Instruct-MLX-8bit
Qwen2.5-1.5B-Instruct-MLX-8bit is a text generation model from majentik. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
8-bit (group-size 64) MLX quantization of Qwen/Qwen2.5-1.5B-Instruct. Uniform affine 8-bit; ≈16-bit quality. This pack is the teacher for the DWQ sibling below.
All-time downloads
68
Public
Parameters
1.5B
1.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.6 GB · 99%
Parameter types
How the weights are stored.
U321.5B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-1.5B-Instruct-MLX-8bit
8-bit (group-size 64) MLX quantization of Qwen/Qwen2.5-1.5B-Instruct. Uniform affine 8-bit; ≈16-bit quality. This pack is the teacher for the DWQ sibling below.
Variants
<!-- sibling-table -->| Variant | Size | Status |
|---|---|---|
| Qwen2.5-1.5B-Instruct-MLX-8bit | 1.5 GB | this repo — teacher |
| Qwen2.5-1.5B-Instruct-MLX-4bit | 0.93 GB | plain affine 4-bit (gs32) |
| Qwen2.5-1.5B-Instruct-MLX-4bit-DWQ | 0.93 GB | DWQ (distilled from this pack) |
Reproduce
python -m mlx_lm convert --hf-path Qwen/Qwen2.5-1.5B-Instruct \
--mlx-path Qwen2.5-1.5B-Instruct-MLX-8bit -q --q-bits 8 --q-group-size 64
Usage
pip install mlx-lm
python -m mlx_lm generate --model majentik/Qwen2.5-1.5B-Instruct-MLX-8bit \
--prompt "The capital of France is"
License
Apache-2.0, inherited from the base model Qwen/Qwen2.5-1.5B-Instruct.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen2
- License
- apache-2.0
- Created
- Jul 14, 2026
- Updated
- Jul 14, 2026