Downloads · 30 days
68
13% of all-time downloads
Auguments/Josiefied-Qwen3.5-2B-gabliterated-v1-MTP-GGUF-BF16
Josiefied-Qwen3.5-2B-gabliterated-v1-MTP-GGUF-BF16 is a machine learning model from Auguments. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf.
Downloads · 30 days
68
13% of all-time downloads
All-time downloads
519
Public
Repo size
5.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.5 GB · 100%
From the Hugging Face model README
Highest quality GGUF - BF16.
In this repo:
BF16 conversion, and Q6_K converted from BF16
MTP block included
For mmproj, use unsloth's or bartowski's.
Converted using base llama.cpp b9294. Never versions can't convert this particular repo to GGUF due to regressed Transformers.