image_ccil

Image CCIL checkpoints

Selected PushT, Square and ToolHang policies

SR ± SE below uses pooled binary success over 150 tests: SE = sqrt(p(1-p)/150). Units are percentages. Each evaluation uses inference seeds 42, 1042, 2042 and 50 test episodes per seed; these are not independent training seeds. Repeated initial states may introduce correlation, which this binomial SE does not account for. PushT SR uses a 0.95 success threshold; continuous mean score is not SR.

See machine-readable results and sources. Square E2E420 was evaluated with the corrected inference-seed handling on 2026-09-15. Other rows retain their published historical evaluations and were not rerun during this update; evaluation runtime/horizon differences remain possible. The old ToolHang baseline 36% number came from a single seed, not the standardized 3-by-50 summary.

Existing checkpoints, shared dynamics, and historical evaluation records are preserved. The table lists the selected main comparison only.

Other tasks

Can and Transport artifacts and published results are unchanged by this update.

Can (structured artifacts)

The Can files mirror the PushT and Square layouts. Standardized offline results use diffusion inference seeds 42, 1042, and 2042; 50 test episodes per inference seed; environment seeds 100000..100049; and success threshold 0.95. The baseline and sequential experiments use the first 20 demonstrations from the 40-trajectory (20%) source dataset, corresponding to 10% of the full dataset.

The two sequential policies share can/seq_shared_dynamics/dynamics.pkl and its training configuration. Their distinct generation settings are stored as augmentation_config.yaml in the respective policy directories. Each policy directory contains exactly one selected checkpoint, its 56 fixed Robomimic initial states, and the standardized 3-by-50 evaluation summary, JSON, and CSV. The complete extraction, dynamics, augmentation, and finetuning recipe is kept in can/run_can_seq.sh.

Transport (structured artifacts)

The Transport baseline and sequential experiment use the first 20 demonstrations from the 40-trajectory (20%) source dataset, corresponding to 10% of the full dataset. Standardized offline results use diffusion inference seeds 42, 1042, and 2042; 50 test episodes per inference seed; six train episodes retained in the evaluation batch; environment seeds 100000..100049; global scheduler RNG; render offsamples 0; and success threshold 0.95.

Each policy directory contains the selected checkpoint, its 56 fixed Robomimic initial states, and the standardized 3-by-50 evaluation files. The complete 20-demonstration sequential pipeline is stored in transport/run_transport_seq.sh.