Downloads · 30 days
504
4% of all-time downloads
Qwen2.5-VL-7B-Instruct-GGUF
samgreen/Qwen2.5-VL-7B-Instruct-GGUF
Qwen2.5-VL-7B-Instruct-GGUF is a image-text-to-text model from samgreen. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Converted and quantized using HimariO's fork using this procedure. No IMatrix.
All-time downloads
13.7K
Public
Repo size
42 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf42 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Mar 21, 2025
- Updated
- Apr 2, 2025
- SHA
- 81e42945
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-VL-7B-Instruct
Converted and quantized using HimariO's fork using this procedure. No IMatrix.
The fork is currently required to run inference and there's no guarantee these checkpoints will work with future builds. Temporary builds are available here. The latest tested build as of writing is qwen25-vl-b4899-bc4163b.
Edit:
As of 1-April-2025 inference support has been added to koboldcpp.
Usage
./llama-qwen2vl-cli -m Qwen2.5-VL-7B-Instruct-Q4_K_M.gguf --mmproj qwen2.5-vl-7b-instruct-vision-f16.gguf -p "Please describe this image." --image ./image.jpg
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Languages
- en
- Created
- Mar 21, 2025
- Updated
- Apr 2, 2025