webbrain-vl-2-450M

WebBrain VL 2 450M

WebBrain VL 2 450M is a browser-GUI specialist derived from LiquidAI/LFM2.5-VL-450M. It turns a browser viewport screenshot into the six-section observation format consumed by WebBrain's planning agent. This repository preserves both the merged Transformers checkpoint and the matching LoRA adapter.

Deployed ONNX/WebGPU benchmark

The separately published webbrain-one/webbrain-vl-2-450M-onnx package reached 44/100 strict passes and a 76.24% mean rubric score in its Q4-decoder/FP16-vision deployment. The WebBrain point in both charts below is that deployed ONNX/WebGPU row, not the 36/100 merged-PyTorch row reported later.

All rows used the same 100 screenshots and production six-section prompt. The benchmark images, rubrics, runner, and committed result files are public. Gemma E4B is plotted at its effective 4B class. Latency is omitted because the rows used different machines, quantizations, and inference stacks.

Further reading:

• Tiny Vision Models Compared II
• From 16K to 50K Browser Screenshots

Intended use

• Browser screenshot description for a downstream automation planner.
• Visible UI text, inputs, form state, dialogs, errors, loading indicators, consent surfaces, CAPTCHAs, overlays, and blockers.
• A compact local fallback when a larger vision model is unavailable.

This is not a general replacement for a frontier VLM. Do not treat an observation as authorization to perform an action or trust it for passwords, payments, identity, or other high-impact decisions.

Training

Validation was measured on the immutable 3,121-row validation split. The held-out 100-case WebBrain suite was not used for checkpoint selection. The table below compares the two candidate checkpoints with the same deterministic post-training evaluator. Its absolute loss scale differs from the in-training Trainer metric; the periodic Trainer loss independently improved from 0.366836 at step 500 to 0.326216 at step 2,500.

The root model and adapter/ are the final one-epoch checkpoint.

Data

The public corpus is webbrain-one/webbrain-vl-2-450M-dataset at commit fb191a0b73e0906e6c3b9f35f6ec0dba1337b72c. It contains exactly 50,000 unique browser screenshots:

Teacher labels comprise 49,634 accepted responses from qwen/qwen3.6-35b-a3b and 366 from Qwen/Qwen3.6-35B-A3B-Q4_K_M. Teacher outputs can contain OCR errors or hallucinations.

The 50K mix was deliberately balanced across 16,646 legacy rows and targeted browser capabilities: multilingual OCR (8,000), forms (4,500), authentication (2,500), modals/consent (3,500), loading states (2,500), tables (3,500), dashboards (2,500), calendars (2,500), occlusion/contrast (1,500), and general browser pages (2,354).

The frozen local snapshot ID is fb55b3afe2026634d5fadbe35dc4bae5b00602b44634459f65ca93e27f227218. Validation confirmed zero exact or perceptual overlap with WebBrain's unchanged 100-case suite and zero train/validation leakage. A source- and category-balanced manual audit accepted all 44 sampled records.

Evaluation

The unchanged 100-case WebBrain browser-vision suite used the production six-section prompt exactly once after checkpoint selection.

Machine-readable results are in eval/. Latency is implementation- and hardware-specific, so it is not presented as a portable speed claim.

Limitations

• Small, low-contrast, occluded, or non-Latin text can still be missed.
• UI labels and state can be hallucinated, especially around overlays.
• Focus, disabled state, exact form errors, and readiness signals need visual corroboration.
• The model inherits teacher errors and response-style biases.
• General-image regression has not been measured; evaluate separately before using this checkpoint outside browser screenshots.
• A syntactically valid six-section response does not make automation safe.

License and attribution

This derivative is distributed under the LFM Open License v1.0, subject to its redistribution and attribution terms. Retain the included LICENSE, the base-model attribution, and all dataset source licenses. Dataset components retain their row-level upstream licensing recorded in the dataset repository.

Reproducibility

release-manifest.json, the training configuration and metrics, machine-readable evaluation files, and SHA256SUMS pin the artifact provenance and released files. Historical manifest and evaluation fields retain the repository IDs that were current when the release was produced; the current public names are the webbrain-vl-2-450M repositories linked in this card.