Downloads · 30 days
380
12% of all-time downloads
Qwen3-VL-4B-Instruct-gguf
John1604/Qwen3-VL-4B-Instruct-gguf
Qwen3-VL-4B-Instruct-gguf is a image-text-to-text model from John1604. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
3.1K
Public
Repo size
25.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf25.1 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025
- SHA
- 0fc69e3a
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3 VL 4B Instruct
Image to text, and text to text.
quantized models Comparison
| Type | Bits | Quality | Description |
|---|---|---|---|
| IQ1 | 1-bit | very Low | Minimal footprint; worse than Q2/IQ2 |
| Q2/IQ2 | 2-bit | 🟥 Low | Minimal footprint; only for tests |
| Q3/IQ3 | 3-bit | 🟧 Low–Med | “Medium” variant |
| Q4/IQ4 | 4-bit | 🟩 Med–High | “Medium” — 4-bit |
| **Q5 ** | 5-bit | 🟩🟩 High | Excellent general-purpose quant |
| **Q6_K ** | 6-bit | 🟩🟩🟩 Very High | Almost FP16 quality, larger size |
| **Q8 ** | 8-bit | 🟩🟩🟩🟩 | Near-lossless baseline |
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025