Downloads · 30 days
40.7K
26% of all-time downloads
noctrex/Huihui-Qwen3-VL-4B-Instruct-abliterated-GGUF
Huihui-Qwen3-VL-4B-Instruct-abliterated-GGUF is a image-text-to-text model from noctrex. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are quantizations of the model Huihui-Qwen3-VL-4B-Instruct-abliterated.
Downloads · 30 days
40.7K
26% of all-time downloads
All-time downloads
157K
Public
Repo size
52.7 GB
Likes
29
Public
Click a slice to open those files.
.gguf52.7 GB · 100%
From the Hugging Face model README
These are quantizations of the model Huihui-Qwen3-VL-4B-Instruct-abliterated.
They have been updated to use the imatrix from unsloth.
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-4B-Instruct-abliterated
Download the latest llama.cpp to use them.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results. F32 > BF16 > F16