Downloads · 30 days
4
2% of all-time downloads
dxx117/Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0
Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0 is a machine learning model from dxx117. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama-cpp. The card lists the license as apache-2.0.
This is a GGUF release of Qwen3.5-397B-A17B using the Unsloth UD IQ2XXS quant as the trunk model, with a Q80 MTP draft block grafted on for speculative decoding experiments.
Downloads · 30 days
4
2% of all-time downloads
All-time downloads
245
Public
Repo size
122 GB
Likes
0
Public
Click a slice to open those files.
.gguf122 GB · 100%
From the Hugging Face model README
This is a GGUF release of Qwen3.5-397B-A17B using the Unsloth UD IQ2_XXS quant as the trunk model, with a Q8_0 MTP draft block grafted on for speculative decoding experiments.
The MTP layers in this release were grafted from a vanilla Qwen3.5-397B source, because some downstream 397B variants retain MTP metadata/config but do not retain the actual MTP weights.
That means this model is best treated as an experimental MTP graft
This release is mainly for:
This repo contains the split GGUF parts for:
Unsloth IQ2_XXS trunk + Q8_0 MTP graft
For fair comparisons, test with: