Downloads · 30 days
75
39% of all-time downloads
schneewolflabs/B1-9B-GGUF
B1-9B-GGUF is a machine learning model from schneewolflabs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Q80 (the quant every card number was measured on) and vision mmproj for schneewolflabs/B1-9B — the B0-9B iteration that answers after it thinks.
Downloads · 30 days
75
39% of all-time downloads
All-time downloads
190
Public
Repo size
10.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf10.7 GB · 100%
From the Hugging Face model README
Q8_0 (the quant every card number was measured on) and vision mmproj for schneewolflabs/B1-9B — the B0-9B iteration that answers after it thinks.
llama-server -m B1-9B-Q8_0.gguf -ngl 99 -c 8192 --jinja -fa on -np 1 \
--spec-type draft-mtp --spec-draft-n-max 4 \
--mmproj B1-9B-mmproj-f16.gguf
Same architecture and layer count as B0-9B, so the
B0-9B-GGUF deployment guide — offload rules,
f16 KV cache, 6GB recipes — applies unchanged. With thinking on, pass tool definitions through
the native tools field and do not prefix /think; that request shape is where the
answer-after-thinking gain is largest.