molmoact2-so101nexus-lora-champion

ataghof/molmoact2-so101nexus-lora-champion

molmoact2-so101nexus-lora-champion is a robotics model from ataghof. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for lerobot. The card lists the license as apache-2.0.

MolmoAct2 is Ai2's open 5B vision-language-action model, shipped in LeRobot. This is a LoRA fine-tune of allenai/MolmoAct2-SO100101 that picks up a red cube and places it on a blue target in a MuJoCo simulator of the…

Downloads · 30 days

22% of all-time downloads

All-time downloads

111

Public

Parameters

5.6B

11.5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors11.5 GB · 100%

Parameter types

How the weights are stored.

BF165.4B · 97%

Base models

allenai/MolmoAct2-SO100_101

Model card

From the Hugging Face model README

MolmoAct2 x SO-101 sim, LoRA champion (v6)

MolmoAct2 is Ai2's open 5B vision-language-action model, shipped in LeRobot. This is a LoRA fine-tune of allenai/MolmoAct2-SO100_101 that picks up a red cube and places it on a blue target in a MuJoCo simulator of the SO-101 arm: from 0% zero-shot to 93% grasp in five days on one 24 GB GPU, with no human demonstrations.

Full story with videos: project page.

Results

Scored on 30 held-out cube positions, never seen in training:

Metric	v6
Grasp (cube held in the gripper)	93%
Strict success (placed on target, arm at rest)	9/30 (30%)
Loose (released within 6 cm of target)	50%

Recipe

500 scripted-expert demos in the sim, with injected noise and recovery (DART-style)
Binary gripper (open/closed), success-state endings, slow release
10-step action chunks, absolute joint targets
LoRA on the VLM plus full training of the action expert, one 24 GB GPU

The single biggest win was the binary gripper. Delta actions hurt, so v6 drops them.

Use it

from lerobot.policies.molmoact2.modeling_molmoact2 import MolmoAct2Policy

pol = MolmoAct2Policy.from_pretrained("ataghof/molmoact2-so101nexus-lora-champion")
pol.config.inference_action_mode = "continuous"  # not saved at train time
pol.to("cuda").eval()

The full eval harness (rollouts in the SO-101 sim, scoring, video) is in the repo.