Downloads · 30 days
32
9% of all-time downloads
RoQwen2.5-VL-3B-Instruct-GGUF
costinstroie/RoQwen2.5-VL-3B-Instruct-GGUF
RoQwen2.5-VL-3B-Instruct-GGUF is a machine learning model from costinstroie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
GGUF quantization of OpenLLM-Ro/RoQwen2.5-VL-3B-Instruct, converted with llama.cpp's converthftogguf.py. Two files:
All-time downloads
348
Public
Repo size
3.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.4 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026
- SHA
- acd09ded
Base models
Model card
From the Hugging Face model README
RoQwen2.5-VL-3B-Instruct-GGUF (Q4_K_M + mmproj F16)
GGUF quantization of OpenLLM-Ro/RoQwen2.5-VL-3B-Instruct,
converted with llama.cpp's convert_hf_to_gguf.py. Two files:
RoQwen2.5-VL-3B-Instruct-Q4_K_M.gguf— the text/language-model half, Q4_K_MRoQwen2.5-VL-3B-Instruct-mmproj-F16.gguf— the vision projector (multimodal), F16
Load both together in LM Studio / llama.cpp for image input, or just the text file for text-only use.
Non-commercial (cc-by-nc-4.0, inherited from the base model).
- License
- cc-by-nc-4.0
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026