Downloads · 30 days
25
5% of all-time downloads
eepos/Qwen3.6-27B-MTP-IQ5_KS-GGUF
Qwen3.6-27B-MTP-IQ5_KS-GGUF is a machine learning model from eepos. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXPERIMENTAL, I'm just a hobbyist, this might be crap. Works with a fairly recent version of ikllama.cpp only.
Downloads · 30 days
25
5% of all-time downloads
All-time downloads
461
Public
Repo size
20.2 GB
Likes
2
Public
Click a slice to open those files.
.gguf20.4 GB · 100%
From the Hugging Face model README
EXPERIMENTAL, I'm just a hobbyist, this might be crap. Works with a fairly recent version of ik_llama.cpp only.
GGUF from ubergarm/Qwen3.6-27B-GGUF
MTP layer from Radamanthys11/Qwen3.6-27B-MTP-Q8_0-GGUF
combined with a script by tschunschi: https://huggingface.co/ubergarm/Qwen3.6-27B-GGUF/discussions/2#69f537e8dc0f21b75e58123d
Thanks to all of the above!
Settings to enable:
-mtp --draft-max 2 --draft-p-min 0.0
--draft-max 3 might be good also