Downloads · 30 days
51
12% of all-time downloads
Wichtelchen-Qwen3.5-9B-GGUF
schneewolflabs/Wichtelchen-Qwen3.5-9B-GGUF
Wichtelchen-Qwen3.5-9B-GGUF is a image-text-to-text model from schneewolflabs. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
All-time downloads
414
Public
Repo size
30.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf30.7 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026
- SHA
- ecf35e21
Try a prompt
Base models
Model card
From the Hugging Face model README
Wichtelchen-Qwen3.5-9B — GGUF
GGUF quants of schneewolflabs/Wichtelchen-Qwen3.5-9B — the Wichtel operator recipe on Qwen3.5-9B: delegation 10/10, Hemlock 56.1% on hembench. See the main card for the full ladder and limitations.
| file | quant | use |
|---|---|---|
| Wichtelchen-Qwen3.5-9B-Q8_0.gguf | Q8_0 | reference quality — all benchmark numbers were measured on this |
| Wichtelchen-Qwen3.5-9B-Q6_K.gguf | Q6_K | near-Q8 quality, smaller |
| Wichtelchen-Qwen3.5-9B-Q5_K_M.gguf | Q5_K_M | balanced |
| Wichtelchen-Qwen3.5-9B-Q4_K_M.gguf | Q4_K_M | smallest recommended |
Serving
llama-server -m Wichtelchen-Qwen3.5-9B-Q8_0.gguf -ngl 99 -c 8192 --jinja -fa on -np 1 \
--spec-type draft-mtp --spec-draft-n-max 4
The checkpoint carries the MTP head, so --spec-type draft-mtp speculative decoding works.
For vision, add the mmproj: --mmproj Wichtelchen-Qwen3.5-9B-mmproj-f16.gguf.
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- apache-2.0
- Languages
- en
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026