ContextRL_Qwen2.5_VL_7B

ContextRL-Qwen2.5-VL-7B

This is the multimodal model released with the paper Context-Aware RL for Agentic and Multimodal LLMs. It is fine-tuned from Qwen2.5-VL-7B-Instruct using ContextRL, a context-aware reinforcement learning method that augments standard GRPO with an auxiliary context-selection objective to improve fine-grained visual grounding.

Results

Across 12 diverse multimodal benchmarks, ContextRL improves over the standard GRPO baseline by +2.0 points on average, while improving every individual benchmark.

The +2.0 average gain over GRPO also exceeds the +0.8 of PAPO, a method purpose-built for multimodal perception (see the paper for the full comparison).

Usage

This model follows the same interface as Qwen2.5-VL-7B-Instruct and can be loaded with transformers. Training and evaluation code, data construction pipelines, and detailed configurations are available in the repository: 👉 https://github.com/xupy2003/ContextAwareRL Please refer to the repo's README for environment setup, inference scripts, and reproduction instructions.