Downloads · 30 days
713
34% of all-time downloads
MTP-Qwen3.5-122B-A10B-GGUF
tomngdev/MTP-Qwen3.5-122B-A10B-GGUF
MTP-Qwen3.5-122B-A10B-GGUF is a machine learning model from tomngdev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains MTP GGUF files only for Qwen/Qwen3.5-122B-A10B.
All-time downloads
2.1K
Public
Repo size
23.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf23.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026
- SHA
- 8a583dbc
Base models
Model card
From the Hugging Face model README
MTP-Qwen3.5-122B-A10B-GGUF
This repository contains MTP GGUF files only for Qwen/Qwen3.5-122B-A10B.
To be used with models without MTP included, such as mudler/Qwen3.5-122B-A10B-APEX-GGUF
It does not include the full base model. These files are intended to be used as the MTP / speculative decoding component together with the matching full model GGUF.
Q4_K_M and Q8_0 quants used unsloth/Qwen3.5-122B-A10B-MTP-GGUF for recipe.
Files
| File | Quant | Size |
|---|---|---|
mtp-BF16.gguf | BF16 | 7.55 GiB |
mtp-F16.gguf | F16 | 7.55 GiB |
mtp-Q8_0.gguf | Q8_0 | 4.02 GiB |
mtp-Q4_K_M.gguf (Recommended) | Q4_K_M | 2.99 GiB |
Usage
Example with llama-server:
llama-server \
-m /path/to/Qwen3.5-122B-A10B.gguf \
-md /path/to/mtp-Q4_K_M.gguf \
--spec-type draft-mtp \
--spec-draft-n-max 2
Notes
- These files are not usable standalone.
- Use only with the matching base model.
- License follows the original base model license.
- License
- apache-2.0
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026