Downloads · 30 days
13
8% of all-time downloads
Qwen2.5-1.5B-Instruct-MLX-8bit
Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit
Qwen2.5-1.5B-Instruct-MLX-8bit is a text generation model from Irfanuruchi. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This repository contains an MLX-converted and 8-bit quantized version of Qwen/Qwen2.5-1.5B-Instruct.
All-time downloads
163
Public
Parameters
1.5B
1.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.6 GB · 99%
Parameter types
How the weights are stored.
U321.5B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-1.5B-Instruct (MLX, 8-bit)
This repository contains an MLX-converted and 8-bit quantized version of
Qwen/Qwen2.5-1.5B-Instruct.
- No fine-tuning or training was performed
- Format conversion + post-training quantization only
- Optimized for Apple Silicon and on-device usage
Usage
pip install -U mlx-lm
mlx_lm.generate \
--model Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit \
--prompt "Write a helpful onboarding message for an iOS app in 3 bullet points."
Bench notes (MacBook Pro M3 Pro)
- Prompt tokens: 45
- Generation tokens: 100
- Generation speed: ~74.7 tokens/sec
- Peak memory: ~1.717 GB
Related models
- 4-bit variant (recommended default for iPhone):
https://huggingface.co/Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit
- Task
- Text Generation
- Library
- mlx
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jan 6, 2026
- Updated
- Jan 17, 2026