griffin-alpha-s-robotwin

Griffin Alpha-S, RoboTwin 2.0 fine-tune (flow-matching head)

The default head of Griffin Alpha-S: a 910M-parameter flow-matching action expert attached layer-by-layer (mixture-of-transformers) to a Qwen3-VL-4B backbone that was pre-trained on a multi-embodiment robot-data mixture. Inference integrates 10 Euler steps from noise to a 50-step action chunk.

Fine-tuned from griffinlabs/Griffin-Alpha-S on RoboTwin 2.0 aloha-agilex, clean setting only: all 50 tasks, 50 episodes each (2,500 episodes, 549,787 frames), 6 epochs = 25,776 steps at an effective batch of 128, full fine-tune of backbone and expert. This is the 6-epoch final; no checkpoint selection was performed (RoboTwin has no offline validation split), so quote it as "the 6-epoch final, unselected".

What is baked in

• Policy type griffin_alpha; cameras observation.images.cam_high, observation.images.cam_left_wrist, observation.images.cam_right_wrist (prompt order) at 480x640; 14-D state and action ([left arm x6, left gripper, right arm x6, right gripper], joint positions) over the canonical 32-wide head; n_action_steps=50 in the config. The results below were produced executing 25 of the 50 predicted steps before replanning (the RoboTwin client's replan_steps=25); pass n_action_steps=25 to reproduce them.
• Relative actions ON (use_relative_actions=true, relative_exclude_joints=["gripper"]): the twelve arm dimensions are predicted relative to the current observation.state, the two grippers absolute. The action feature names are stored in the config and processors, so the mask reloads as saved.
• Prompt header [embodiment: Aloha AgileX bimanual, 2 grippers; arm control mode: joint_position]; include_proprio=true, condition_on_subtask=true, apply_inference_center_crop=true, num_inference_steps=10.
• Normalization statistics from the RoboTwin clean training corpus (quantile normalization of state and of the relative actions).

RoboTwin 2.0 results

Closed loop in RoboTwin 2.0 (SAPIEN), 50 tasks x 100 episodes per setting, single seed, 10 Euler steps, 25 of the 50 predicted steps executed per replan, unseen instructions. Training used demo_clean only, so the two columns are an in-distribution / domain-randomization-generalization pair and must be quoted together: the demo_randomized figure is depressed relative to a model trained on randomized data and is not comparable to published RoboTwin leaderboard numbers.

Clean beats randomized on 45 of 50 tasks, is worse on 4, tied on 1. The range is wide: adjust_bottle and click_bell at 100% down to open_microwave at 2%, with precise bimanual placement (handover_block, hanging_mug, place_can_basket) in single digits.

<details> <summary>Per-task success rate (%), 100 episodes each</summary> </details>

Caveats: single seed, and 100 episodes per task is roughly +/-5 points at 50%, so per-task deltas under about 10 points are not individually resolvable. Only the final epoch was evaluated; the earlier epochs were not.

Use

Install the plugin, then any lerobot CLI understands the policy type (griffin_alpha):

pip install git+https://github.com/griffinlabs-ai/alpha-s.git

import lerobot_policy_griffin_alpha  # registers the policy types
from lerobot.policies.factory import make_pre_post_processors
from lerobot_policy_griffin_alpha import GriffinAlphaPolicy

policy = GriffinAlphaPolicy.from_pretrained("griffinlabs/griffin-alpha-s-robotwin")
preprocessor, postprocessor = make_pre_post_processors(
    policy.config, pretrained_path="griffinlabs/griffin-alpha-s-robotwin",
    preprocessor_overrides={"device_processor": {"device": "cuda"}},
)

The observation dict takes the three cameras as float CHW images in [0, 1], observation.state as the 14-D joint vector above, and the instruction under task; predict_action_chunk returns the 50-step chunk, and the postprocessor turns it back into absolute joint targets.

Fine-tune with lerobot-train --policy.path=griffinlabs/griffin-alpha-s-robotwin --dataset.repo_id=...; see docs/finetuning.md in the code repository, including how to rebuild the processors for a different robot or camera set.

License

Weights: CC BY-NC-SA 4.0 (see LICENSE). The plugin code is Apache-2.0. The base model, Qwen3-VL-4B-Instruct, is Apache-2.0.