smolvla_pick_pen_v2_frozen

smolvla_pick_pen_v2_frozen

SmolVLA (450M) fine-tuned from lerobot/smolvla_base on an SO-101 teleop dataset for language-conditioned pen selection: "Pick up the blue pen" / "Pick up the pink pen" / "Pick up the grey pen" (all three pens present in every episode).

This variant keeps SmolVLA's defaults: only the action expert trains, the VLM and vision encoder are frozen, so fine-tuning physically cannot overwrite the pretrained language grounding. Part of a 3-way sweep — see also smolvla_pick_pen_v2_lr1e4 and smolvla_pick_pen_v2_lr5e5, which both unfreeze the vision encoder.

Training

Cameras are recorded as observation.images.top / observation.images.wrist and remapped onto SmolVLA's baked-in camera keys at train time:

--rename_map='{"observation.images.top": "observation.images.camera1",
               "observation.images.wrist": "observation.images.camera2"}'

The same rename map must be passed at eval time (lerobot-rollout / lerobot-record).