Downloads · 30 days
31
17% of all-time downloads
schneewolflabs/B0-27B-GGUF
B0-27B-GGUF is a image-text-to-text model from schneewolflabs. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Q80 quant of schneewolflabs/B0-27B plus the vision mmproj (f16). MTP tensors intact — --spec-type draft-mtp works.
Downloads · 30 days
31
17% of all-time downloads
All-time downloads
179
Public
Repo size
30 GB
Likes
0
Public
Click a slice to open those files.
.gguf30 GB · 100%
From the Hugging Face model README
Q8_0 quant of schneewolflabs/B0-27B
plus the vision mmproj (f16). MTP tensors intact — --spec-type draft-mtp works.
llama-server -m B0-27B-Q8_0.gguf --mmproj B0-27B-mmproj-f16.gguf \
-ngl 99 -c 16384 --jinja -fa on -np 1 \
--spec-type draft-mtp --spec-draft-n-max 4