Downloads · 30 days
28.3K
13% of all-time downloads
noctrex/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF
Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF is a image-text-to-text model from noctrex. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
Downloads · 30 days
28.3K
13% of all-time downloads
All-time downloads
218K
Public
Repo size
338 GB
Likes
33
Public
Click a slice to open those files.
.gguf338 GB · 100%
From the Hugging Face model README
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
The imatrix from unsloth has been used for these.
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
Download the latest llama.cpp to use them.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results.
F32 > BF16 > F16.