Downloads · 30 days
186
11% of all-time downloads
Qwen3-VL-8B-Instruct-heretic-gguf
SergiusFlavius/Qwen3-VL-8B-Instruct-heretic-gguf
Qwen3-VL-8B-Instruct-heretic-gguf is a image-text-to-text model from SergiusFlavius. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository provides a GGUF quantized builds of Qwen3-VL-8B-Instruct-heretic for llama.cpp.
All-time downloads
1.6K
Public
Repo size
6.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf6.2 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Dec 25, 2025
- Updated
- Dec 25, 2025
- SHA
- ed61ecfe
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-VL-8B-Instruct-heretic-gguf
Overview
This repository provides a GGUF quantized builds of Qwen3-VL-8B-Instruct-heretic for llama.cpp.
This model is a decensored derivative of the official Qwen/Qwen3-VL-8B-Instruct,
modified using Heretic v1.1.0.
Quantization Details
- Backend:
llama.cpp - Commit:
7537 (e68c19b0f) - Method:
Q4_K_Mfor weights,FP16for multimodal adapter - Imatrix Optimization: [x]️ (custom dataset)
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Created
- Dec 25, 2025
- Updated
- Dec 25, 2025