Downloads · 30 days
136
41% of all-time downloads
Qwen2.5-VL-7B-Instruct-gguf
chibifire/Qwen2.5-VL-7B-Instruct-gguf
Qwen2.5-VL-7B-Instruct-gguf is a machine learning model from chibifire. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF conversions of Qwen's Qwen2.5-VL 7B instruction-tuned vision-language model, at f16 and q80 precision.
All-time downloads
328
Public
Repo size
23.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf23.3 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Sep 6, 2026
- Updated
- Oct 11, 2026
- SHA
- 7cbcf21e
Model card
From the Hugging Face model README
Qwen2.5-VL-7B-Instruct-gguf
GGUF conversions of Qwen's Qwen2.5-VL 7B instruction-tuned vision-language model, at f16 and q8_0 precision.
What it is for
This repo holds GGUF files converted from the instruction-tuned 7B Qwen2.5-VL model. There is one full-precision f16 file and one 8-bit q8_0 file. Use them with llama.cpp or another GGUF runtime.
Provenance
- Upstream model: Qwen/Qwen2.5-VL-7B-Instruct.
- Safetensors mirror: chibifire/Qwen2.5-VL-7B-Instruct.
Use
hf download chibifire/Qwen2.5-VL-7B-Instruct-gguf Qwen2.5-VL-7B-Instruct.q8_0.gguf --local-dir .
For prompts and model behavior, read the upstream model card.
Licence
Apache 2.0, the upstream licence. Terms: https://www.apache.org/licenses/LICENSE-2.0. These terms travel with the weights. Keep this link when you copy or redistribute them.
- License
- apache-2.0
- Created
- Sep 6, 2026
- Updated
- Oct 11, 2026