Qwen3.8-27B-mtp-drafter-mlx-4bit

Bendyline/Qwen3.8-27B-mtp-drafter-mlx-4bit

Qwen3.8-27B-mtp-drafter-mlx-4bit is a machine learning model from Bendyline. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.

The native multi-token-prediction head of Qwen/Qwen3.8-27B, extracted as a standalone MLX drafter and quantized to 4-bit affine (group 64). It carries no embedding or LM head of its own — it binds to the target model'…

Downloads · 30 days

214

21% of all-time downloads

All-time downloads

Public

Repo size

239 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors239 MB · 100%

At a glance

Library: mlx
License: apache-2.0
Model type: qwen3_5_mtp
Access: Public
Created: Aug 29, 2026
Updated: Aug 29, 2026
SHA: 7e359eb3

Base models

Qwen/Qwen3.8-27B

Model card

From the Hugging Face model README

MTP drafter for Qwen/Qwen3.8-27B

Speculative decoding verifies every proposed token against the target model, so this drafter changes throughput only, never output: greedy decoding is byte-identical with and without it.

Reproducing

Built by scripts/build-mtp-drafter.mjs from Gezel — a local-first desktop app for assembling a team of AI agents that run on your own machine:

git clone https://github.com/bendyline/gezel.git
node scripts/build-mtp-drafter.mjs --source Qwen/Qwen3.8-27B --out <dir>

The script fetches only the checkpoint shard(s) carrying the mtp.* tensors (1 of 18 for this model), splits the head into a standalone drafter, and quantizes it to 4-bit.

License

Apache-2.0, inherited from Qwen/Qwen3.8-27B. Weights are a derivative of that checkpoint.

Library: mlx
Type: qwen3_5_mtp
License: apache-2.0
Created: Aug 29, 2026
Updated: Aug 29, 2026