basevla-libero-noaug-nostate

BaseVLA — LIBERO 4-suite (Qwen2.5-VL-3B), vision-only, no augmentation

Plain behaviour cloning: no V-JEPA, no latent alignment, no decorrelation — the objective is L1(action) alone. Trained without proprioception and without augmentation, starting from a ManiSkill-pretrained VLA rather than from Qwen directly.

Initialised from Ngseo/basevla-maniskill-aug (step 40,000), then fine-tuned for 100,000 steps on LIBERO.

Data

The four standard LIBERO suites, equal sampling weight per suite (weight / n_frames, so suite size does not bias the mix):

Front camera (observation.images.image) only; wrist camera dropped. 10 fps.

Architecture

Qwen2.5-VL-3B + LoRA ─ forward_full_hidden ─┬─ Head A → z_a ─┐
                                            └─ Head B → z_b ─┴─ concat → ResNetActionHead → 30×7

L = L1(action)

Two choices worth flagging:

• chunk_size 30, not the LIBERO-standard 10. The ManiSkill checkpoint was trained at 30, and the action head's output layer is chunk × action_dim, so 30 is required for its weights to load. At LIBERO's 10 fps that is a 3-second horizon rather than 1 second — evaluation must use the same chunk length.
• --no_state, so the state token collapses to a constant learned bias (state_proj(0)) and no proprioception reaches the model.

Training curve

Related

Note that this model and basevla-libero-aug differ in more than augmentation (state input, chunk length and initialisation all differ), so they are not a controlled augmentation ablation.

Not evaluated in simulation or on a robot. The losses above are training-set L1 on normalised actions; no LIBERO rollout success rate is reported here.

Contents

import torch
ck = torch.load("checkpoint.pt", map_location="cpu", weights_only=False)
ck["step"]        # 100000
ck["args"]        # full training config
ck["agg_stats"]   # action normalisation used at train time

checkpoint.pt holds policy (full VLM incl. LoRA), latent_head, free_latent_head, action_head, optimizer, agg_stats and args.