Qwen3.5-VL-9B-UI-Venus-2-NOESIS-NF4

<!-- apex-banner --> <div style="background-color: #f59e0b; color: white; padding: 20px; border-radius: 10px; text-align: center; margin: 20px 0;"> <h2 style="color: white; margin: 0 0 10px 0;">⚡ Each donation funds the next large quant.</h2> <p style="font-size: 16px; margin: 0 0 15px 0;">I host free GGUF or MoE quants as independent research.<br> Local hardware: <b>Mechrevo Kuangshi GM7AG0M</b> — RTX 3060 Laptop 6GB GDDR6, 64GB DDR5, i7-12700H (14C/20T, 4.7GHz), Windows 11, Samsung 990 Pro.<br> Good for imatrix and 0.6–35B-class work in RAM. <b>9B+ and searches need rented H200/Blackwell</b>, typically $100 per quant.</p> <p style="font-size: 20px; margin: 0;"> <a href="https://boosty.to/amaimediacom" style="color: white; text-decoration: underline;">🎉 Boosty🦄</a>  |  <a href="https://donatex.gg/widgets/donation-goal/89bc59e8-b69c-467a-9aa0-5e1c3f8842d6" style="color: white; text-decoration: underline;">☕ Buy Me a Coffee🦄</a>  |  <a href="https://www.donationalerts.com/r/djbionicl" style="color: white; text-decoration: underline;">⭐ DonationAlerts🦄</a> </p> <p style="font-size: 14px; margin: 10px 0 0 0; opacity: 0.9;">💚 Thanks to Hugging Face for extra storage.🦄</p> </div>

---

NOESIS / AMAImedia

Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: DHCF-FNO — Deterministic Hybrid Control Framework for Frozen Neural Operators).

• Founder: Ilia Bolotnikov
• Organization: AMAImedia.com
• X (Twitter): @AMAImediacom
• LinkedIn: Ilia Bolotnikov
• Telegram: @djbionicl
• Release date: 2026-08-27

---

UI-Venus-2-9B

<div align="center">

</div>

UI-Venus-2 is a general-purpose foundation GUI agent designed to operate across mobile applications, web platforms, and desktop operating systems through a unified closed-loop reasoning–action framework: the agent observes the current interface, reasons about the task state, executes an action, and incorporates environmental feedback into its next decision.

To bridge the gap from benchmark-oriented models toward dependable real-world applications, UI-Venus-2 jointly scales three critical dimensions:

• Environments — expanding the executable mobile pool to 170+ multilingual apps (100+ Chinese and 70+ English), alongside a curated web pool of 4,000+ domains across 19 categories and native desktop operating systems;
• Tasks — a deep-research pipeline that grounds generated instructions in the actual functionality of each application, improving the accuracy, validity, and executability of task queries;
• Verification — trace-level and sample-level evaluators based on task-relevant visual keypoints and multi-model voting, providing reliable RL reward signals that are robust to reward hacking.

UI-Venus-2 is evaluated for consequential-action safety on OSHarm and OSBlind. UI-Venus-2-9B achieves an Attack Success Rate (ASR, lower is better) of 11.3% on OSHarm and 48.8% on OSBlind, compared with 25.3% and 79.4%, respectively, for its Qwen3.5-9B base model.

This repository releases the full-parameter weights of UI-Venus-2-9B, initialized from Qwen3.5-9B, which achieves near state-of-the-art performance among models of comparable scale across GUI grounding, mobile, web, computer-use, and CAPTCHA benchmarks.

<div align="center"> <img src="images/performance_overview.png" width="100%" alt="Performance overview of UI-Venus-2 across GUI agent benchmarks"> </div>

Highlights

• Scaled multilingual mobile-use environments with reliable task generation. A substantially expanded executable mobile pool covering Chinese and English app ecosystems, paired with a deep-research-driven query-generation strategy grounded in real application functionality.
• Computer-use capability built from the ground up. Dedicated desktop operating-system capabilities constructed from scratch through computer-use data collection and task-specific training, extending the UI-Venus family to mobile, web, and OS interaction in one unified end-to-end agent.
• Keypoint-grounded verification. Task completion is judged on task-relevant visual keypoints rather than a coarse holistic look at the final screen, with multi-model voting aggregating heterogeneous judges — reducing single-judge bias and making the reward signal robust to reward hacking.
• Multi-teacher on-policy distillation. Domain-specialized teachers are consolidated with structured, action-aware supervision that concentrates the distillation signal on the executable behaviors governing environment interaction.

Training Pipeline

UI-Venus-2 is trained on a deliberately complementary mixture of five task families — Grounding, CAPTCHA, Mobile, Web, and Computer — through three stages:

1. Multimodal Mid-Training — large-scale trajectory-based training over simulated mobile, web, and OS environments, with navigation data as the dominant component and human–discriminator collaborative verification filtering invalid or ambiguous interactions.
2. Offline RL — independent step-level optimization across Grounding, CAPTCHA, Mobile, Web, and Computer tasks develops domain-specialized policies.
3. Multi-teacher On-policy Distillation — domain-specialized teachers are consolidated into a single unified policy that preserves the broad multimodal reasoning of the base model while composing spatial grounding, verified interaction, and long-horizon navigation.

<div align="center"> <img src="images/performance_overview.png" width="90%" alt="The three-stage training pipeline of UI-Venus-2"> </div>

The training data is produced by a deep-research-driven task-generation pipeline spanning mobile, browser, and computer environments. The active report describes a curated web pool of 4,000+ domains across 19 categories, seeded with 45,000 tasks selected from InSTA-150k-v3; synthetic grounding and CAPTCHA records are exported for task-specific SFT and RL.

<div align="center"> <img src="images/performance_overview.png" width="100%" alt="System overview: task generation pipeline and trajectory collection across mobile, browser, and computer environments"> </div>

Quick Start

Serving with vLLM

The following is the intended serving configuration. It was not live-canary-validated as part of this model-card update, so pin and verify a vLLM version appropriate for Qwen3.5 before deployment.

pip install -U vllm

vllm serve inclusionAI/UI-Venus-2-9B \
    --port 8000 \
    --tensor-parallel-size 1 \
    --max-model-len 262144 \
    --reasoning-parser qwen3

The server exposes an OpenAI-compatible API at http://localhost:8000/v1.

Inference Configuration

The evaluation settings depend on the task family:

• General agentic tasks: use temperature 1.0, enable reasoning, and retain the complete reasoning history in the multi-step context.
• GUI grounding: disable reasoning and use temperature 0 for direct point localization.
• CAPTCHA: use the CAPTCHA-specific prompt and a parser/executor that supports multiple actions in one model turn.

Starting the vLLM server alone does not provide the complete closed-loop GUI agent. Reference prompts, action parsers, and runnable examples for Mobile, Computer, Browser, Grounding, and CAPTCHA are available in the UI-Venus code repository. Environment coverage differs by domain: the included Mobile and Computer examples support multi-turn inference over prerecorded screenshots, while real-device ADB automation, browser interaction, and benchmark-specific setup are documented separately in the repository.

Release Status

• Model weights: included in this repository.
• Code: available in the UI-Venus GitHub repository.
• Project page: available at ui-venus.github.io/UI-Venus-2.
• Technical report: available at arXiv:2609.00028.
• License: the model-weight license is pending final confirmation and will be added before public release. The Apache-2.0 declaration has intentionally not been carried over because the current upstream materials contain conflicting license statements.

Results

The tables below compare the released 9B checkpoint and the 27B family checkpoint with a representative subset of general-purpose and GUI-specialized baselines from the technical report. – denotes an unreported result, and * denotes a baseline evaluated or reproduced by the UI-Venus authors under the stated protocol. Full comparisons, source citations, and metric definitions are provided in the technical report. Live-environment results may vary with evaluation date and environment state.

Mobile Use

Reported score (%) across interactive mobile-agent benchmarks, including controlled simulations and real-application environments.

MobileWorld reports GUI-only success rate on 117 tasks: the primary value uses a 50-step budget and the value in parentheses uses 100 steps. VenusBench-Mobile uses its 149-task primary pool. MemGUI reports Main Results pass@1.

Computer Use

Reported score (%) on open-ended tasks in desktop environments; benchmark-specific definitions follow the table.

OSWorld-Verified comparisons use the 361-task setting reported by their cited sources and may use model-specific action scaffolds, so they should be interpreted as benchmark-level references rather than controlled ablations. OSWorld 2.0 reports the official Binary Accuracy and Partial Score metrics over 108 tasks under a 150-step budget. DeskCraft is an author-evaluated aggregate over the 538-task union of the Standard and Interactive splits and differs from official split-level reporting.

Web Navigation

Success rate (%) on end-to-end web navigation; Odysseys reports the average rubric score (%).

WebVoyager uses the refreshed 595-task split; live-site states may vary by evaluation date. Odysseys evaluates 200 live-web tasks with gemini-3.1-flash-lite-preview as the rubric judge and reports both the average fraction of satisfied rubric items and the percentage of tasks for which every rubric item is satisfied.

GUI Grounding

Accuracy (%) on element localization across high-resolution professional software, mobile / web / desktop interfaces, and reasoning-heavy instructions.

VenusBench-GD reports English-instruction micro-average point-in-box accuracy.

CAPTCHA Solving

Pass@1 (%) across five CAPTCHA benchmarks. VenusBench-CAPTCHA spans eight real-world interaction types—including slider puzzles, image rotation, text and icon click, OCR entry, and visual reasoning—and requires the full multi-action sequence in a single turn.

All values are Pass@1. VenusBench-CAPTCHA reports the micro-average over all 219 fixed examples. The public-benchmark evaluation uses 1,000 sampled MCA-Bench examples, 15 retained NextGen-CAPTCHAs task types, and 16 retained Open CaptchaWorld task types.

Safety

OSHarm covers explicit safety threats including deliberate misuse, prompt injection, and model misbehavior. OSBlind tests benign-looking instructions whose execution context can produce harmful outcomes. Both report Attack Success Rate (ASR, lower is better).

These results do not make harmful-action risk negligible. Deployments should keep human confirmation and application-level safeguards around consequential operations, and CAPTCHA capabilities should only be used in authorized environments.

Citation

Please cite the UI-Venus-2 technical report as follows:

@misc{venusteam2026uivenus2technicalreport,
  title         = {UI-Venus-2 Technical Report},
  author        = {Venus Team and Zhuohan Cai and Haoxing Chen and Jiaxuan Chen and Weizhi Chen and Changlong Gao and Zhangxuan Gu and Yuan Guo and Yusong Hu and Jianrong Jiang and Jianguo Li and Runze Li and Jinzhen Lin and Zhenyu Ma and Changhua Meng and Han Peng and Xinyu Qiu and Shuheng Shen and Zhongyi Shui and Weiqiang Wang and Ming Wen and Zhuoer Xu and Hang Yan and Kaiwen Yang and Ruilin Yao and Nanjun Yu and Zhengwen Zeng and Lianrui Zhang and Yunzhu Zhang and Zhe Zhao and Beitong Zhou},
  year          = {2026},
  eprint        = {2609.00028},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2609.00028}
}

@article{uivenus15,
  title   = {UI-Venus-1.5 Technical Report},
  author  = {{Venus Team, Ant Group}},
  journal = {arXiv preprint arXiv:2602.09082},
  year    = {2026}
}

@article{uivenus2025,
  title   = {UI-Venus Technical Report: Building High-performance UI Agents with RFT},
  author  = {{Venus Team, Ant Group}},
  journal = {arXiv preprint arXiv:2508.10833},
  year    = {2025}
}