Downloads · 30 days
17
6% of all-time downloads
Qwythos-27B-v1-MLX-MTP
FancieF/Qwythos-27B-v1-MLX-MTP
Qwythos-27B-v1-MLX-MTP is a machine learning model from FancieF. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
Standalone Multi-Token Prediction (MTP) head split from empero-ai/Qwythos-27B-v1.
All-time downloads
270
Public
Parameters
425M
869 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors849 MB · 98%
At a glance
- Library
- mlx
- License
- apache-2.0
- Model type
- qwen3_5_mtp
- Access
- Public
- Created
- Jul 31, 2026
- Updated
- Aug 3, 2026
- SHA
- 9cd3e632
Base models
Model card
From the Hugging Face model README
Qwythos-27B-v1 · MLX MTP Drafter
Standalone Multi-Token Prediction (MTP) head split from empero-ai/Qwythos-27B-v1.
Not a full LLM. Load only as
--draft-modelnext to an MLX VLM target.
Which repo should I download?
| Repo | Role |
|---|---|
| VLM 4-bit | Main model (recommended) |
| VLM BF16 | Main model (high RAM) |
| This MTP drafter | Optional decode speed-up |
mlx_vlm.convert drops mtp.*. This repo puts them back as model_type: qwen3_5_mtp (block_size=4, ~829MB).
Install
pip install -U mlx-vlm
Usage (copy-paste)
mlx_vlm.generate \
--model FancieF/Qwythos-27B-v1-MLX-VLM-4bit \
--draft-model FancieF/Qwythos-27B-v1-MLX-MTP \
--draft-kind mtp \
--draft-block-size 4 \
--prompt "Explain gated linear attention in three sentences." \
--thinking-mode disabled \
--temperature 0.6
With image (prefill on main model; MTP helps the text tail):
mlx_vlm.generate \
--model FancieF/Qwythos-27B-v1-MLX-VLM-4bit \
--draft-model FancieF/Qwythos-27B-v1-MLX-MTP \
--draft-kind mtp \
--draft-block-size 4 \
--image ./photo.jpg \
--prompt "Describe this image." \
--thinking-mode disabled
Server:
mlx_vlm.server \
--model FancieF/Qwythos-27B-v1-MLX-VLM-4bit \
--draft-model FancieF/Qwythos-27B-v1-MLX-MTP \
--draft-kind mtp \
--draft-block-size 4
LM Studio note
Do not expect this file to work as LM Studio’s generic Draft Model. For LM Studio MTP, use official GGUF with MTP baked in: empero-ai/Qwythos-27B-v1-GGUF (*MTP*Q4_K_M*) + enable MTP Speculative Decoding.
How it was produced
python -m mlx_vlm.speculative.drafters.qwen3_5_mtp.split \
--model /path/to/Qwythos-27B-v1 \
--output ./Qwythos-27B-MTP \
--block-size 4
License & attribution
Derived from empero-ai/Qwythos-27B-v1 (Apache-2.0). Unofficial MLX drafter for Apple Silicon.
Links
| Main VLM 4-bit | FancieF/Qwythos-27B-v1-MLX-VLM-4bit |
| VLM BF16 | FancieF/Qwythos-27B-v1-MLX-VLM-bf16 |
| Base | empero-ai/Qwythos-27B-v1 |
| ModelScope (ZH) | Fancie/Qwythos-27B-v1-MLX-MTP |
- Library
- mlx
- Type
- qwen3_5_mtp
- License
- apache-2.0
- Languages
- en
- Created
- Jul 31, 2026
- Updated
- Aug 3, 2026