Downloads · 30 days
34
2% of all-time downloads
jpetrina/ThinkingCap-Qwen3.6-27B-IQ4_XS-pure-GGUF
ThinkingCap-Qwen3.6-27B-IQ4_XS-pure-GGUF is a image-text-to-text model from jpetrina. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf.
This GGUF is generated with identical approach taken by Ununnilium's Qwen3.6-27B-IQ4XS-pure-GGUF but targetting bottlecapai's ThinkingCap variant of Qwen3.6.
Downloads · 30 days
34
2% of all-time downloads
All-time downloads
1.5K
Public
Repo size
29.1 GB
Likes
3
Public
Click a slice to open those files.
.gguf14.5 GB · 100%
From the Hugging Face model README
This GGUF is generated with identical approach taken by Ununnilium's Qwen3.6-27B-IQ4_XS-pure-GGUF but targetting bottlecapai's ThinkingCap variant of Qwen3.6.
llama-quantize --pure \
ThinkingCap-Qwen3.6-27B-f16.gguf \
thinkingcap-qwen3.6-27b-IQ4_XS-pure.gguf \
IQ4_XS \
$(nproc)
For additional details see bottlecapai's ThinkingCap article. For recommended Qwen3.6 parameters and deployment see the Unsloth Qwen3.6 Guide.
GGUF / llama.cpp quantizations of bottlecapai/ThinkingCap-Qwen3.6-27B — capability of Qwen3.6-27B with 50% less thinking tokens on average, achieved by finetuning Qwen3.6-27B (Qwen Team, 2026) with online reinforcement learning while preserving the original answer quality and style.
➡️ Full model description, evaluation results (multi-seed, statistically tested), recommended sampling params, and citation: see the main model card at bottlecapai/ThinkingCap-Qwen3.6-27B.
GGUF is a single-file model format for running LLMs locally with llama.cpp and compatible runtimes (Ollama, LM Studio, …). The quantized variants below store weights at reduced precision — e.g. ~4.7 bits per weight for Q4_K_M instead of the 16-bit f16 source — cutting download size and memory severalfold at a small, measured quality cost.
| File | Quant | Size |
|---|---|---|
ThinkingCap-Qwen3.6-27B-Q4_K_M.gguf | Q4_K_M | 15.7 GB |
ThinkingCap-Qwen3.6-27B-Q8_0.gguf | Q8_0 | 27.1 GB |
ThinkingCap-Qwen3.6-27B-f16.gguf | f16 | 50.9 GB |
mmproj-ThinkingCap-Qwen3.6-27B-f16.gguf | mmproj (vision) | 0.9 GB |
f16 is the unquantized source; Q8_0 is near-lossless; Q4_K_M is the recommended size/quality balance for most local setups.
When shown, Mean KLD is the mean KL divergence of the quant vs the f16 model over a held-out corpus (lower = closer to full precision).
# pull a specific quant straight from the Hub and chat
llama-cli -hf bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF:Q4_K_M -p "Hi"
# or download one file and run it
huggingface-cli download bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF ThinkingCap-Qwen3.6-27B-Q4_K_M.gguf --local-dir .
llama-cli -m ThinkingCap-Qwen3.6-27B-Q4_K_M.gguf -p "Hi"
ThinkingCap is a vision-language model. Image input needs the multimodal projector
mmproj-ThinkingCap-Qwen3.6-27B-f16.gguf (in this repo) loaded alongside a text GGUF — the
single f16 mmproj pairs with any of the quants above.
mmproj-*.gguf from this repo; LM Studio auto-detects it and enables the image (🖼️) button.huggingface-cli download bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF \
ThinkingCap-Qwen3.6-27B-Q4_K_M.gguf mmproj-ThinkingCap-Qwen3.6-27B-f16.gguf --local-dir .
llama-mtmd-cli -m ThinkingCap-Qwen3.6-27B-Q4_K_M.gguf \
--mmproj mmproj-ThinkingCap-Qwen3.6-27B-f16.gguf --image photo.jpg -p "Describe this image."
--mmproj mmproj-ThinkingCap-Qwen3.6-27B-f16.gguf to expose an OpenAI-compatible vision endpoint.