Downloads · 30 days
4
14% of all-time downloads
manihani4/portal-vlm-qwen25vl-lora-lm
portal-vlm-qwen25vl-lora-lm is a machine learning model from manihani4. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as mit.
Grounding LoRA (r16/a32), 252 LM-decoder sites, native absolute-pixel coordinate dialect. wave-ui-25k, 1 epoch, best checkpoint at step 372/1489 by held-out click probe.
Downloads · 30 days
4
14% of all-time downloads
All-time downloads
28
Public
Repo size
120 MB
Likes
0
Public
Click a slice to open those files.
.safetensors120 MB · 100%
From the Hugging Face model README
Grounding LoRA (r16/a32), 252 LM-decoder sites, native absolute-pixel coordinate dialect. wave-ui-25k, 1 epoch, best checkpoint at step 372/1489 by held-out click probe.
Part of the portal-vlm release - an independent replication of Ramp Labs' PorTAL (portable task adapters via hypernet-generated LoRA) extended to vision-language models on GUI grounding.
| ScreenSpot-v2 overall | web split | |
|---|---|---|
| this artifact | 77.1% | 72.8% |
Qwen/Qwen2.5-VL-3B-Instruct @ 66285546d2b821cf421d4f5eb2576359d3770cd3configs/qwen25vl_lora_lm.yamlresults/qwen25vl_lora_lm.jsongit clone https://github.com/robbym-dev/portal-vlm && cd portal-vlm && uv sync
uv run python scripts/eval.py --config configs/qwen25vl_lora_lm.yaml --adapter hf:manihani4/portal-vlm-qwen25vl-lora-lm
Standard PEFT LoRA adapter - also loadable directly with peft.PeftModel.from_pretrained on the pinned base model.