Downloads · 30 days
11
30% of all-time downloads
RyanL22/pi05-rby1-wujihand2-masquerade-baseline-20k
pi05-rby1-wujihand2-masquerade-baseline-20k is a robotics model from RyanL22. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for lerobot. The card lists the license as apache-2.0.
LeRobot 0.6.1 pi05base fine-tuned as a human-video baseline for RB-Y1 with Wujihand2 hands. One of two visual-alignment baselines trained on identical data, labels and hyper-parameters; only the image edit differs, so…
Downloads · 30 days
11
30% of all-time downloads
All-time downloads
37
Public
Parameters
4.1B
9.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.4 GB · 100%
How the weights are stored.
BF163.6B · 87%
From the Hugging Face model README
LeRobot 0.6.1 pi05_base fine-tuned as a human-video baseline for RB-Y1 with Wujihand2 hands.
One of two visual-alignment baselines trained on identical data, labels and hyper-parameters; only the image
edit differs, so the two are directly comparable.
Masquerade / Phantom style: the human arm is removed with ProPainter and a MuJoCo render of the RB-Y1 + Wujihand2 arms and hands is composited on top at the retargeted pose (always on top, no depth test). Robot teleop frames get the same render over the real robot at the measured joint state, so training and inference see the same edit.
| source | episodes | note |
|---|---|---|
| RB-Y1 teleop v1 | 209 | 4 categories (ball, bottle, small box, doll), real robot |
| RoboTryOn-human-2 | 451 | 11 categories, human video re-shot to match the RB-Y1 ZED view |
660 episodes, 170,971 frames, 30 fps, stereo 288x512 (both ZED eyes). 15 cells (4 robot + 11 human), share proportional to sqrt(frames).
Human labels come from HaWoR stereo triangulation retargeted to RB-Y1: 7-DoF damped-least-squares arm IK to the wrist pose plus per-finger IK for Wujihand2. The action leads the image by 7 (arm) / 4 (hand) frames, matching the measured teleop lead; the render is drawn at the label pose, not the action.
observation.joint_position[10:64] (right arm 7, right hand 20, left arm 7, left hand 20). Wheels, torso and head are constant in this data and excluded.observation.images.base_0_rgb, right eye -> observation.images.left_wrist_0_rgb.12 air-fryer episodes have IK wrist residuals of 2-5 cm because the left hand opening the door is outside RB-Y1's reach. They were kept, as in the OpenArm baselines. Masquerade stays image-label consistent there since it renders the label pose; the EgoMimic red line follows the human hand and so disagrees with the label by a few cm.