Downloads · 30 days
208
7% of all-time downloads
llmware/qwen2.5-vl-3b-instruct-gguf
qwen2.5-vl-3b-instruct-gguf is a machine learning model from llmware. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
qwen2.5-vl-3b-instruct-gguf is a GGUF Q4KM quantized version of [Qwen2.5-VL-Instruct](https://www.huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct, providing a fast, small inference implementation, optimized for AI PCs.
Downloads · 30 days
208
7% of all-time downloads
All-time downloads
2.9K
Public
Repo size
3.3 GB
Likes
1
Public
Click a slice to open those files.
.gguf3.3 GB · 100%
From the Hugging Face model README
qwen2.5-vl-3b-instruct-gguf is a GGUF Q4_K_M quantized version of [Qwen2.5-VL-Instruct](https://www.huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct, providing a fast, small inference implementation, optimized for AI PCs.