Downloads · 30 days
44
10% of all-time downloads
minhnguyenh/Vintern-1B-v3_5-BF16-GGUF
Vintern-1B-v3_5-BF16-GGUF is a image-text-to-text model from minhnguyenh. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
<div align="center" <img src="https://cdn-uploads.huggingface.co/production/uploads/6336b5c831efcb5647f00170/-G297bBqMzYvTbD6Bkd9.png" width="500"/ </div
Downloads · 30 days
44
10% of all-time downloads
All-time downloads
443
Public
Repo size
1.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.9 GB · 100%
From the Hugging Face model README
Original model: https://huggingface.co/5CD-AI/Vintern-1B-v3_5
Converted using llama.cpp@b6301 (self-compiled, CUDA Toolkit 13.0) convert-hf-to-gguf.py file.
To run this model, use:
llama-server -m Vintern-1B-v3_5-BF16.gguf --mmproj mmproj-Vintern-1B-v3_5-BF16.gguf --repeat-penalty 2.5
Add -ngl 99 if using compatible GPU, or custom set --threads for fine-tuned performance.
MMPROJ file generated from original model's preprocessor_config.json: https://huggingface.co/OpenGVLab/InternVL2_5-1B