Downloads · 30 days
19
30% of all-time downloads
zhuqiang/Vision-OPD-Qwen2.5-VL-7B-Instruct-RandomDrop5-1Epoch
Vision-OPD-Qwen2.5-VL-7B-Instruct-RandomDrop5-1Epoch is a image-text-to-text model from zhuqiang. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Qwen2.5-VL-7B-Instruct trained for one epoch with Vision-OPD using random 5% visual-token retention for the student and full visual tokens for the teacher. This is the final step-64 checkpoint.
Downloads · 30 days
19
30% of all-time downloads
All-time downloads
64
Public
Parameters
8.3B
16.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.6 GB · 100%
From the Hugging Face model README
Qwen2.5-VL-7B-Instruct trained for one epoch with Vision-OPD using random 5% visual-token retention for the student and full visual tokens for the teacher. This is the final step-64 checkpoint.
The checkpoint can run with full visual tokens using standard Transformers. For 5% visual-token inference, use the pruning-aware serving code in prune-opd.
Training data: Vision-OPD-6K.