Downloads · 30 days
134
9% of all-time downloads
Qwen3.8-27B-MTP-bf16-MLX
lukaskremla/Qwen3.8-27B-MTP-bf16-MLX
Qwen3.8-27B-MTP-bf16-MLX is a text generation model from lukaskremla. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This repository contains the native Multi-Token Prediction (MTP) tensors extracted from Qwen/Qwen3.8-27B and converted into the standalone MLX drafter format expected by mlx-vlm.
All-time downloads
1.4K
Public
Parameters
425M
862 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors849 MB · 98%
At a glance
- Task
- Text Generation
- Library
- mlx
- License
- apache-2.0
- Model type
- qwen3_5_mtp
- Access
- Public
- Created
- Aug 14, 2026
- Updated
- Sep 1, 2026
- SHA
- bb6ef811
Try a prompt
Model card
From the Hugging Face model README
lukaskremla/Qwen3.8-27B-MTP-bf16-MLX
This repository contains the native Multi-Token Prediction (MTP) tensors extracted from Qwen/Qwen3.8-27B and converted into the standalone MLX drafter format expected by mlx-vlm.
This is not a standalone language model. It must be loaded as the draft model alongside a compatible Qwen3.8-27B target model.
The same BF16 drafter can be used with the 2-bit, 3-bit, 4-bit, 5-bit, 6-bit and 8-bit MLX target models. Quantizations don't need to match.
You can download the vision capable or text-only Qwen 3.8 27B weights in a variety of MLX quantizations from this collection Qwen 3.8 27B MLX-Quants (Vision, Text-Only & MTP).
Hugging Face might render incorrect parameter counts for this model, it is a common display bug for MLX quants.
Credits
Converted to MLX format from Qwen/Qwen3.8-27B using mlx-vlm version 0.6.13.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5_mtp
- License
- apache-2.0
- Created
- Aug 14, 2026
- Updated
- Sep 1, 2026