Downloads · 30 days
0
cloudwalk-research/gr00t-n17-g1-grab-bottle-rh-210ep-v2-finetune
gr00t-n17-g1-grab-bottle-rh-210ep-v2-finetune is a robotics model from cloudwalk-research. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for gr00t. The card lists the license as other.
v2 fine-tune of NVIDIA GR00T N1.7-3B (paper) on a Unitree G1 humanoid driven by the SONIC whole-body controller.
Downloads · 30 days
0
Access
Public
Updated Oct 7, 2026
Repo size
6.9 GB
Likes
1
Public
Click a slice to open those files.
.safetensors6.9 GB · 100%
From the Hugging Face model README
v2 fine-tune of NVIDIA GR00T N1.7-3B (paper) on a Unitree G1 humanoid driven by the SONIC whole-body controller.
Single-handed pick task ("grab the bottle", RIGHT hand). Trained at the CloudWalk Robotics Lab (CW-RL), 2026-06, on a curated 210-episode real-robot teleoperation dataset, for the UNITREE_G1_SONIC embodiment. Released as a reference fine-tune for teams building manipulation policies on the GR00T + SONIC + MuJoCo/G1 stack.
Predecessor: cloudwalk-research/gr00t-n17-g1-grab-bottle-rh-105ep-v1-finetune — v1, trained on the original 105-episode dataset and validated closed-loop. v2 re-trains the same recipe on a cleaned dataset: the v1 episodes were split into shorter windows with low-quality segments removed.
This is a behavior-cloning fine-tune of the full 3B model. v2 was validated closed-loop and outperforms v1 — it grasps the bottle from object poses where v1 failed (see Evaluation).
| Base | GR00T-N1.7-3B — Qwen3-VL vision-language backbone + flow-matching diffusion-transformer (DiT) action head |
| Parameters | 3.14 B total / 1.62 B trainable (51.5%) |
| Dataset | cloudwalk-research/gr00t-g1-grab-bottle-right-hand-v2 — 210 episodes, 62,772 frames @ 50 Hz, 640×480 ego_view camera (no wrist cams); curated from the 105-ep v1 dataset (longer episodes split into shorter windows, low-quality segments removed) |
| Robot target | Unitree G1 (29-DoF body) + Inspire FTP hands (6 finger joints + 1 constant-zero 7th channel for Dex3-layout compatibility, via InspireFTPGripMapper) + SONIC whole-body controller |
| Embodiment tag | UNITREE_G1_SONIC (unitree_g1_sonic) |
| State space | 43-D (left_leg 6 + right_leg 6 + waist 3 + left_arm 7 + left_hand 7 + right_arm 7 + right_hand 7) |
| Action space | [40 × 78] = 40-step horizon × (64 motion_token + 7 left_hand_joints + 7 right_hand_joints) |
| Hardware | 6× NVIDIA B200 (sm_100 / Blackwell) |
| Mixed precision | bf16 |
| Optimizer | AdamW, lr 1e-4 cosine, warmup_ratio 0.05, weight_decay 1e-5 |
| Steps / batch | 20,000 (champion) → continued to 40,000 / global batch 48 (8 per GPU × 6 GPUs) |
| Epochs | ≈15.3 @ 20k · ≈30.6 @ 40k (frame-views ÷ 62,772 frames) |
| Augmentation | color jitter (brightness 0.3, contrast 0.4, saturation 0.5, hue 0.08) |
| Wall-clock | ≈65 min to 20k + ≈68 min for 20k→40k (6× B200, ≈4.6–4.9 it/s) |
| Final train loss | ≈ 0.0303 @ step 20,000 (from ≈1.27) · ≈0.02 per-step @ step 40,000 (W&B curve; the HF summary train_loss 0.0135 is resume-deflated — see Evaluation) |
checkpoint-20000/ # 20k steps (~15.3 ep) — closed-loop champion (10/12 grid + 5/5 fixed; validated); the only published checkpoint
README.md # this file
Each checkpoint-NNNNN/ is a self-contained, deploy-ready snapshot:
model-00001-of-00002.safetensors + model-00002-of-00002.safetensors (~6.5 GB, bf16)model.safetensors.index.jsonconfig.jsonembodiment_id.json (contains unitree_g1_sonic)processor_config.jsonstatistics.json (dataset normalization stats)experiment_cfg/ (training config snapshot)DeepSpeed ZeRO partition states, optimizer, scheduler and RNG files are intentionally omitted — they are needed only to resume training and would add several GB per checkpoint.
Training signal. Train loss fell from ~1.27 to ≈ 0.0303 over 20,000 steps (cf. v1 final train_loss ≈ 0.0825). Full curves (loss, grad_norm, learning_rate, GPU util) are tracked in W&B (private run). There is no held-out split — validation defaults to the training data, so treat the loss as a fit probe, not as a generalization measure.
Closed-loop evaluation — completed (v2 is the former champion; superseded by v10, 12/12). checkpoint-20000 was run closed-loop on the physical G1 + SONIC stack. It grasps the bottle from object poses where the v1 policy failed — a qualitative improvement attributed to the distance-to-goal curation (shorter, cleaner windows) — and now has a quantitative grid result behind it. Low BC loss is a healthy prerequisite, not evidence of a good policy — this closed-loop result is the load-bearing signal.
Procedure. The bottle was placed at 12 fixed positions spanning one half-side of the table (the table is fixed relative to the robot). These are the same 12 positions used for data collection (see the source dataset card). One trial per position (12 trials) gives the grid result; then 5 consecutive trials were run at the fixed black-rectangle position, and (for v2) 5 more at a second fixed blue-rectangle position. Legend: 🟥 red = knocked the bottle over · 🟧 orange = stuck in an "indecision" loop, never reaching the bottle · 🟩 green = successfully grasped the bottle. The policy was invoked with the task prompt "grab the bottle" — the same prompt used to collect the data.

Results — checkpoint-20000.
Grid (12 fixed positions, 1 trial each):
| Outcome | Count | Rate |
|---|---|---|
| 🟩 Success | 10/12 | 83% |
| 🟧 Non-convergence (indecision loop) | 1/12 | 9% |
| 🟥 Error (knocked bottle over) | 1/12 | 8% |
Fixed positions (5 consecutive trials each):
| Position | Success |
|---|---|
| Black rectangle | 5/5 (100%) |
| Blue rectangle | 2/5 (40%) |
⚠️ Single-trial methodology. Each of the 12 grid positions is tested once (1 trial/position); repeated placements at the same spot can succeed or fail differently — the fixed-position repeat test, where run, shows this per-position variance. Treat the grid score as a single-pass signal, not a repeated-trial mean.
Conclusion. v2 is the former production champion (superseded by v10, 12/12): highest grid success (10/12, 83%), perfect at the black fixed position (5/5), and the tied-lowest knock-over rate (8%, tied with v6). The distance-to-goal curation's shorter, cleaner windows beat every other curation strategy in the family (v4/v5/v6).
Continued training (20k → 40k). The 20k champion was continued to 40,000 steps (true resume). The per-step train/loss fell from ≈0.04 (at the 20k restart) and settled around ≈0.02 by 40k (W&B, private run). The HF summary train_loss of 0.0135 is resume-deflated — on resume HF divides the 20k-step loss sum by max_steps=40,000, so the real per-step loss is ≈2× that (the curve is the source of truth). At ≈30.6 epochs on 62,772 frames this risks overfit, and lower training loss (no held-out split) is not evidence of better closed-loop behavior. checkpoint-20000 remains the validated, production champion and the only checkpoint published on HF; the 40k continuation was logged in W&B but not published as a checkpoint (one checkpoint per repo, lineage storage policy).
from huggingface_hub import snapshot_download
local = snapshot_download(
repo_id="cloudwalk-research/gr00t-n17-g1-grab-bottle-rh-210ep-v2-finetune",
repo_type="model",
allow_patterns=["checkpoint-20000/*"], # champion (the only published checkpoint)
)
print(local)
Start the GR00T policy server (from an Isaac-GR00T environment) pointing at the downloaded checkpoint:
python -m gr00t.eval.run_gr00t_server \
--model-path <local>/checkpoint-20000 \
--embodiment-tag UNITREE_G1_SONIC \
--device cuda:0 --host 0.0.0.0 --port 5550
Closed-loop control of the G1 (sim or real) is driven by the SONIC whole-body controller in GR00T-WholeBodyControl: the policy emits motion_token + hand-joint targets that the SONIC WBC decodes into whole-body joint commands. The server must be launched with the same UNITREE_G1_SONIC embodiment tag used in training. See the NVlabs VLA inference tutorial. This checkpoint is not plug-and-play on hardware — it requires the SONIC C++ deploy stack and the matching G1 setup.
ego_view (head) camera was recorded — no wrist cameras. The policy has never seen wrist views.motion_token + hand joints for UNITREE_G1_SONIC; it only produces robot motion through the SONIC WBC + ZMQ deploy pipeline. It is not directly executable on a bare G1.checkpoint-20000 (≈15.3 ep) is published — the validated champion (one checkpoint per repo, lineage storage policy); the 40k continuation was not published as a checkpoint.NCCL_IB_DISABLE=1 NCCL_P2P_LEVEL=NVL (InfiniBand off, P2P over NVLink) and W&B in offline mode (synced post-run). These affect only the training run, not the weights.| Version | Dataset | Episodes | Frames | Epochs @20k | Closed-loop | Notes |
|---|---|---|---|---|---|---|
| v1 | 105ep-v1 | 105 | 70,680 | 13.6 | ✅ 4/12 (33%) | First GR00T N1.7 + SONIC fine-tune at CW-RL; right-hand bottle pick. |
| v2 (this) | right-hand-v2 | 210 | 62,772 | 15.3 | ✅ 10/12 (83%) — former champion | Curated (episodes split into shorter windows, bad segments removed). checkpoint-20000 = former production champion (10/12), superseded by v10 (12/12). |
| v4 | radius-5 | 417 | 48,577 | 19.8 | ✅ 6/12 (50%) | Zero-wandering, most aggressive curation (radius 5 → short windows). |
| v5 | radius-20 | 314 | 50,496 | 19.0 | ✅ 9/12 (75%) | Zero-wandering, least aggressive curation (radius 20 → longer windows, ~161 f/ep). |
| v6 | radius-20-merged | 502 | 120,017 | 8.0 | ✅ 8/12 (67%) | Merged (105-ep + 115-ep "worst-positions"), radius-20 with grasp-frame preservation. Largest set → 20k = only ~8 ep (underfit risk). |
| v7 | speedup-3mm-v1 | 220 | 60,163 | ~16.0 | 7/12 (58%) | DP speedup resampling (wrist-Cartesian, 3 mm/frame, max_K=40) of the merged set; no segment removal — reference baseline. ≈16 ep @20k lands on v2's sweet spot. |
cloudwalk-research/gr00t-g1-grab-bottle-right-hand-v2 (CloudWalk Research, 2026), PICO 4 Ultra teleoperation on the Unitree G1 with SONIC WBC; curated from the 105-ep v1 dataset.Developed by cloudwalk-research in the CloudWalk Robotics Lab (CW-RL). Fine-tuned from nvidia/GR00T-N1.7-3B using Isaac-GR00T; targets the Unitree G1 with the SONIC whole-body controller.
If you build on this checkpoint, cite both upstream GR00T/SONIC and this fine-tune:
@misc{cwrl_gr00t_grab_bottle_v2_2026,
title = {GR00T N1.7 Fine-Tune v2 --- Unitree G1 "grab the bottle" (right hand, SONIC WBC, curated 210-ep dataset)},
author = {{CloudWalk Robotics Lab}},
year = {2026},
howpublished = {Hugging Face model repository},
url = {https://huggingface.co/cloudwalk-research/gr00t-n17-g1-grab-bottle-rh-210ep-v2-finetune}
}
@article{gr00t_n1_2025,
title = {GR00T N1: An Open Foundation Model for Generalist Humanoid Robots},
author = {{NVIDIA}},
year = {2025},
eprint = {2503.14734},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2503.14734}
}
@article{sonic_2025,
title = {SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control},
author = {Luo, Zhengyi and others},
year = {2025},
eprint = {2511.07820},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2511.07820}
}
@software{isaac_gr00t,
title = {{Isaac-GR00T}: NVIDIA's open foundation model stack for generalist humanoid robots},
author = {{NVIDIA}},
url = {https://github.com/NVIDIA/Isaac-GR00T},
year = {2025}
}
Inherits the NVIDIA Open Model License Agreement of the base model nvidia/GR00T-N1.7-3B — see the license terms. This is a research preview: not intended for safety-critical use; closed-loop deployment on a physical humanoid requires human oversight.