Downloads · 30 days
64
9% of all-time downloads
Qwen3.6-27B-Q4-MTPLX
wang-yang/Qwen3.6-27B-Q4-MTPLX
Qwen3.6-27B-Q4-MTPLX is a text generation model from wang-yang. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
An Apple Silicon MLX checkpoint derived from Qwen/Qwen3.6-27B. It includes an MTPLX sidecar for native speculative decoding.
All-time downloads
713
Public
Parameters
26.9B
44.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors14.3 GB · 100%
Parameter types
How the weights are stored.
U3226.9B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.6-27B-Q4-MTPLX
An Apple Silicon MLX checkpoint derived from Qwen/Qwen3.6-27B. It includes
an MTPLX sidecar for native speculative decoding.
This revision uses an optimized mixed-low-bit trunk. On the local WikiText-2 128 x 512 evaluation its perplexity was 8.3781. The complete repository is approximately 14.57 GB.
Standard MLX usage
from mlx_lm import load, generate
model, tokenizer = load("wang-yang/Qwen3.6-27B-Q4-MTPLX")
print(generate(model, tokenizer, prompt="The capital of France is", max_tokens=32))
For speculative decoding, use MTPLX and run mtplx tune on the target Mac.
Observed MTP acceptance and speed are workload-dependent, so applications
should also benchmark representative prompts.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Languages
- en
- Created
- Jul 22, 2026
- Updated
- Jul 24, 2026