s_wam_best_L

LaWAM — closed-loop staircase (variant A), LIBERO best checkpoint

Best-scoring LIBERO checkpoint from the LaWAM closed-loop "staircase" line of work: 0.973 mean success rate across the four LIBERO suites.

• Run id: cl_A_gran10_bs32x2_fixall_bsz64rerun
• Run dir: results/Checkpoints/libero/20260731_195651+cl_A_gran10_bs32x2_fixall_bsz64rerun
• Step: 25 000 (final)
• Seed: 2026

---

1. What the model is

Three parts, trained jointly, all inside the single .pt:

Total 4.39 B parameters (policy_vlm_adapter and policy_action_head alias the same storages as policy_backend, so the on-disk file is 6.7 GB, not the naive sum).

The closed-loop staircase

A 50-action chunk is emitted as 5 groups of 10, and the K=5 flow-matching denoising steps are spread across execution rather than all run up front:

group j     0        1        2        3        4
depth       1        2        3        4        5
condition   o_0      o_10     o_20     o_30     o_40      <- geometric refresh at each boundary
executes    a0..9    a10..19  a20..29  a30..39  a40..49

At every boundary only the geometry is refreshed (a DINOv3 pass over the new observation, ~3 ms); z and h_vlm stay frozen at the draft frame. Training supervision equals inference execution: the strict executed loss only scores each group at its own execution depth under its own execution-time observation.

Trained with a shared tau (token_independent_noise=false) and a fully chained rollout (rollout_align_prob=1.0), plus all three fixes on:

---

2. Results

LIBERO, variant A (num_steps=5, refresh=geo), 10 tasks × 10 trials per suite (400 episodes per row).

Read these numbers with the error bars. They are honest measurements, not tuned headline figures:

• TRIALS=10 runs about 2 points optimistic. The same checkpoint measured at TRIALS=50 scores 0.953.
• Seed variance at identical config spans ~3.5 points (0.973 / 0.938 for two seeds).
• Per-suite noise floor: ±5 points on libero_10, ±2 on the others. Do not draw conclusions from differences under 3 points.

Ablations

The model is extremely dependent on condition freshness. That is the intended property (refresh is what the staircase buys), but it also means this checkpoint degrades sharply if you feed it stale conditions — see §5.

Latency

All end-to-end measured, no arithmetic extrapolation.

---

3. Files

checkpoints/steps_25000_pytorch_model.pt   6.7 GB — the model (self-contained state dict)
config.json                                resolved training config for the run
config.yaml                                same, YAML form
dataset_statistics.json                    action/state normalization statistics — REQUIRED at inference
summary.jsonl                              which steps were checkpointed
logs/train.log                             full training log
logs/train_libero_spec50.yaml              dataset/spec config used
train_scripts/                             the exact launch script + shared helpers
wandb/                                     offline wandb run

dataset_statistics.json is not optional — the action head predicts normalized actions and this file is how they get mapped back.

Only step 25 000 is published here. Steps 5 000–20 000 exist in the original run directory if intermediate checkpoints are needed.

---

4. Usage

The weights alone are not runnable — they need the LaWAM code and two config-only assets.

git clone https://github.com/s1ghhh/lawam_s.git
cd lawam_s
git checkout closedloop-staircase

You additionally need:

Evaluate:

# variant must match the checkpoint — this is an A checkpoint
bash closedloop/eval_closedloop.sh <path>/steps_25000_pytorch_model.pt A
# with ablations
bash closedloop/eval_closedloop.sh <path>/steps_25000_pytorch_model.pt A open chunk10

Reproduce training (2 GPUs, global batch 64, 25 000 steps):

GPUS=0,1 PER_DEVICE_BS=32 GRAD_ACCUM=1 STEPS=25000 \
  bash closedloop/train_A_gran10_bs32_fixall_bsz64.sh

Key hyperparameters: lr 1e-4 (base and action model), 1500 warmup steps, action_horizon=50, num_frames=6, sec_chunk=2.5, horizon_sec=2.5, num_inference_steps=10, repeated_diffusion_steps=2, perceptual_weight=0.1, lam_encoder_distill_weight=0.1.

The learning rate is on a sharp peak. 5e-5 → 0.925 and 5e-4 → 0.920, i.e. about 5 points lost in either direction from 1e-4. Likely because rollout_steer_grad couples the world model and the action head to one learning rate.

---

5. Known caveats

1. Trained with an off-by-one frame grid. This run predates the frame-grid fix. The K+1 boundary frames were laid over [0, N-1] instead of [0, N], so the sampled video deltas were [0, 10, 20, 29, 39, 49] where the execution grid the evaluator actually uses is [0, 10, 20, 30, 40, 50]. Boundaries 3 and 4 were therefore trained one frame early. The 0.973 was measured with that mismatch present in the weights and absent from the evaluator. A retrained, grid-corrected run scores 0.9475 — inside the same-config seed band, so the fix has not been shown to change quality either way. If you are building on this line of work, prefer the corrected training code; if you are reproducing 0.973 exactly, you need the pre-fix dataloader.
2. Do not enable vlm_prefetch at inference — measured −25 points.
3. Off-distribution in chunk mode. chunk10 evaluation of this checkpoint is a coarse reference only; the model was never trained for truncated chunk execution.
4. Stale conditions are fatal, not merely costly (open = 0.105). Any async or pipelined serving scheme must keep the boundary condition fresh, or the model must first be fine-tuned on stale conditions.
5. Training used teacher forcing: the "new observation" at each boundary is the demo frame, which assumes model actions ≈ demo actions. On-policy residual is not addressed by this recipe.
6. LIBERO-only. This checkpoint scores 0.606 on LIBERO-Plus, 15–20 points below models trained on Plus.

---

6. Citation

Part of the LaWAM closed-loop streaming work (Sony proposal line, 2026). Code: https://github.com/s1ghhh/lawam_s, branch closedloop-staircase.