Downloads · 30 days
36
4% of all-time downloads
kdqemre/Qwen3.6-27B-Omnimerge-v4-MTP-Q4_K_L-GGUF
Qwen3.6-27B-Omnimerge-v4-MTP-Q4_K_L-GGUF is a machine learning model from kdqemre. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a Q4KL quantized GGUF version of ManniX-ITA/Qwen3.6-27B-Omnimerge-v4.
Downloads · 30 days
36
4% of all-time downloads
All-time downloads
997
Public
Repo size
17.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf17.4 GB · 100%
From the Hugging Face model README
This is a Q4_K_L quantized GGUF version of ManniX-ITA/Qwen3.6-27B-Omnimerge-v4.
Based on my tests if you are a personal AI person with 24GB Vram, best quant is not Q4_K_M versions. Q4_K_L quantization is offers better performance-size-speed trio. I think this model is performing better among other Qwen3.6 27B versions for general purpose agentic AI use case.
llama-server -m Qwen3.6-27B-Omnimerge-v4-MTP-Q4_K_L.gguf \
-ngl 99 \
-c 16384 \
-fa 1 \
-np 1 --cache-type-k q8_0 --cache-type-v q5_1 --reasoning-format deepseek --reasoning-budget 2048 \
--spec-type draft-mtp --spec-draft-n-max 3 --cache-type-k-draft q5_1 --cache-type-v-draft q5_1 --kv-unified \
--port 8088
Original model licensed under Apache-2.0. This quantized version preserves the original license.