Downloads · 30 days
29
11% of all-time downloads
zhuqiang/Vision-OPD-Qwen3.5-4B-RandomDrop5-Step30
Vision-OPD-Qwen3.5-4B-RandomDrop5-Step30 is a image-text-to-text model from zhuqiang. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Qwen3.5-4B trained with Vision-OPD using random 5% visual-token retention for the student and full visual tokens for the teacher. This is the 30-step proof-of-concept checkpoint.
Downloads · 30 days
29
11% of all-time downloads
All-time downloads
265
Public
Parameters
5.2B
10.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors10.4 GB · 100%
From the Hugging Face model README
Qwen3.5-4B trained with Vision-OPD using random 5% visual-token retention for the student and full visual tokens for the teacher. This is the 30-step proof-of-concept checkpoint.
The checkpoint can run with full visual tokens using standard Transformers. For 5% visual-token inference, use the pruning-aware serving code in prune-opd.
Training data: Vision-OPD-6K.