Downloads · 30 days
748
8% of all-time downloads
noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-i1-GGUF
Huihui-Qwen3-VL-8B-Instruct-abliterated-i1-GGUF is a image-text-to-text model from noctrex. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are quantizations of the model Huihui-Qwen3-VL-8B-Instruct-abliterated.
Downloads · 30 days
748
8% of all-time downloads
All-time downloads
9.4K
Public
Repo size
56.8 GB
Likes
2
Public
Click a slice to open those files.
.gguf56.8 GB · 100%
From the Hugging Face model README
These are quantizations of the model Huihui-Qwen3-VL-8B-Instruct-abliterated.
These quantizations were created using an imatrix merged from combined_all_large and harmful.txt to leverage the abliterated nature of the model.
For higher precision versions (which are not in an need for an imatrix), please refer to the main repository: noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-GGUF
Usage Notes:
mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).