Downloads · 30 days
18
42% of all-time downloads
zhuqiang/Vision-OPD-Qwen2.5-VL-7B-Instruct-RandomDrop5-Step30
Vision-OPD-Qwen2.5-VL-7B-Instruct-RandomDrop5-Step30 is a image-text-to-text model from zhuqiang. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Qwen2.5-VL-7B-Instruct trained for 30 Vision-OPD optimizer steps. The student retains a replayable random 5% subset of post-merge visual tokens, while the EMA teacher uses the full visual-token sequence.
Downloads · 30 days
18
42% of all-time downloads
All-time downloads
43
Public
Parameters
8.3B
16.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.6 GB · 100%
From the Hugging Face model README
Qwen2.5-VL-7B-Instruct trained for 30 Vision-OPD optimizer steps. The student retains a replayable random 5% subset of post-merge visual tokens, while the EMA teacher uses the full visual-token sequence.
Training uses Vision-OPD-6K with 96 prompts and 8 on-policy rollouts per step,
a learning rate of 2e-6, and an EMA teacher update rate of 0.05.
Standard Transformers/vLLM loads the full-token model. RandomDrop5 inference requires the pruning-aware serving code in prune-opd.
Training data: Vision-OPD-6K.