Downloads · 30 days
256
4% of all-time downloads
Tipur/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF
Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF is a image-text-to-text model from Tipur. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
Downloads · 30 days
256
4% of all-time downloads
All-time downloads
6.8K
Public
Repo size
338 GB
Likes
0
Public
Click a slice to open those files.
.gguf338 GB · 100%
From the Hugging Face model README
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
The imatrix from unsloth has been used for these.
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
Download the latest llama.cpp to use them.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results.
F32 > BF16 > F16.