Downloads · 30 days
32
1% of all-time downloads
Qwen3.5-27B-4bit-MLX
TxemAI/Qwen3.5-27B-4bit-MLX
Qwen3.5-27B-4bit-MLX is a text generation model from TxemAI. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
MLX quantization of Qwen/Qwen3.5-27B optimized for Apple Silicon.
All-time downloads
3.8K
Public
Parameters
26.9B
15.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.1 GB · 100%
Parameter types
How the weights are stored.
U3226.9B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-27B MLX 4-bit Quantization
MLX quantization of Qwen/Qwen3.5-27B optimized for Apple Silicon.
Details
- Base model: Qwen/Qwen3.5-27B
- Format: MLX 4-bit (4.501 bits per weight)
- Quantized by: TxemAI
- Quantization tool: mlx-lm
Performance (M4 Max, 128GB)
- Throughput: 29.7 tokens/sec
- Peak RAM: 15.3 GB
Usage
from mlx_lm import load, generate
model, tokenizer = load("TxemAI/Qwen3.5-27B-4bit-MLX")
response = generate(model, tokenizer, prompt="Your prompt here", verbose=True)
When to use this vs 8-bit
Use 4-bit if you want faster inference and lower RAM usage. Use 8-bit version if you prioritize output quality.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Languages
- en
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026