Downloads · 30 days
11
28% of all-time downloads
happyhappy-jun/gr00t-n1.6-ours-racer-ft-cs60k
gr00t-n1.6-ours-racer-ft-cs60k is a robotics model from happyhappy-jun. Use it for the robotics task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This is an independently trained target-task fine-tuning (FT) checkpoint of NVIDIA GR00T N1.6, fine-tuned from the Ours-RACER mid-training checkpoint happyhappy-jun/gr00t-n1.6-ours-racer-mt80k on the 16 composite-seen…
Downloads · 30 days
11
28% of all-time downloads
All-time downloads
40
Public
Parameters
3.3B
6.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.6 GB · 100%
From the Hugging Face model README
This is an independently trained target-task fine-tuning (FT) checkpoint of
NVIDIA GR00T N1.6, fine-tuned from the
Ours-RACER mid-training checkpoint
happyhappy-jun/gr00t-n1.6-ours-racer-mt80k
on the 16 composite-seen (CS) RoboCasa365 target tasks with full-task language only. It is
not an official NVIDIA release.
This repository is released anonymously for ICLR 2027 review.
It is the Ours-RACER member of a three-arm family that shares the target task population, the full-task-only language and the FT recipe, and differs in the mid-training parent (Ours-RACER segmentation instead of UVD-RACER or RDD-RACER). The per-arm staged copies of the target datasets differ only in a subtask-annotation overlay column that this full-task stage never reads. This checkpoint is a flat, full-task policy: it takes the whole task instruction directly and needs no high-level planner.
ft_cs of the ours arm in the iclr2027_ft full-task fine-tuning harnesscheckpoint-60000 (60,000 optimizer updates)182152 on an internal lab Slurm cluster (4 GPUs, single node); the run wrote its
COMPLETE.json marker (global_step 60000, microbatch 32, accumulation 1, num_gpus 4,
effective_batch 128, source_job 182152) on 2026-09-14 after 11 h 33 m of trainingcheckpoint-80000 of run
20260913_mix50_80k/mt (job 47), published as
happyhappy-jun/gr00t-n1.6-ours-racer-mt80k,
loaded weights-only through --base-model-path with a fresh optimizer state — no
optimizer, scheduler or RNG state carried over. The launch contract records the SHA-256 of all
seven files of that base checkpoint, and all seven match the published MT 80K repository
byte-for-byte, so the initialization identity is verified rather than assumed.d0814e7, loaded fresh by the MT parent
(which mid-trained on 300 RoboCasa365 human-teleoperation datasets, 32,043 episodes /
29,106,226 frames, with a 50:50 full-task/subtask language mixture over the Ours
subtask overlay)30a35e2637ea3b470c816c7be8534b57f1943e0b06419327e9cda69e980627d6The model files are copied byte-for-byte from that checkpoint. No weights,
normalization statistics, modality settings, or configuration values were changed
for this upload. See publication_manifest.json for sizes and SHA-256 checksums
of the published source files.
| Item | Value |
|---|---|
| Data | the 16 RoboCasa365 composite-seen (CS16) target LeRobot datasets, equal mix ratios (1 each); 8,077 episodes / 6,002,265 frames — the launch contract's own data_identity {tasks 16, episodes 8077, frames 6002265} |
| Tasks | DeliverStraw, GetToastedBread, KettleBoiling, LoadDishwasher, PackIdenticalLunches, PreSoakPan, PrepareCoffee, RinseSinkBasin, ScrubCuttingBoard, SearingMeat, SetUpCuttingStation, StackBowlsCabinet, SteamInMicrowave, StirVegetables, StoreLeftoversInBowl, WashLettuce |
| Language conditioning | full-task instructions only — the modality config (robocasa365_config.py) exposes the single language key annotation.human.task_description; no subtask language is consumed at this stage, so no segment annotation of any arm enters this run |
| Embodiment tag | NEW_EMBODIMENT |
| Steps | 60,000 (trainer_state.json: global_step 60000, max_steps 60000, epoch 1.0) |
| Effective batch | 128 (global batch 128 × gradient accumulation 1; microbatch 32 per GPU, 4 GPUs) |
| Learning rate | 3e-5, cosine schedule, warmup ratio 0.05 (5%) |
| Weight decay | 1e-5 |
| Seed | 42 |
| Trainable | diffusion/action head, projector and the vision-language LayerNorm, plus the top 4 layers of the language backbone — see the note below. Launch flags: --no-tune-llm --no-tune-visual --tune-projector --tune-diffusion-model |
| Augmentation | color jitter (brightness 0.3, contrast 0.4, saturation 0.5, hue 0.08) |
| Dataloader workers | 8 |
| Save cadence | every 5,000 steps, save_total_limit 2 (so checkpoint-55000 and checkpoint-60000 survived; this repo is checkpoint-60000) |
| Runtime | DeepSpeed 0.17.5, ZeRO stage 2, PyTorch 2.7.1+cu128, Transformers 4.51.3 |
All of the above is read back from the run's own launch_contract.json, which records
the exact launch argument vector (--embodiment-tag NEW_EMBODIMENT --num-gpus 4 --global-batch-size 128 --gradient-accumulation-steps 1 --max-steps 60000 --learning-rate 3e-5 --weight-decay 1e-5 --warmup-ratio 0.05 --seed 42 --dataloader-num-workers 8 --save-steps 5000 --save-total-limit 2 --no-tune-llm --no-tune-visual --tune-projector --tune-diffusion-model --color-jitter-params brightness 0.3 contrast 0.4 saturation 0.5 hue 0.08) together with microbatch 32 / accumulation 1 / num_gpus 4 / effective_batch 128 and the 16 resolved dataset paths,
and from the resolved experiment_cfg/conf.yaml saved next to the checkpoint. The
training log records the launcher's own computed line [deepspeed] version=0.17.5 stage=2 grad_accum=1 num_gpus=4 effective_batch=128. DeepSpeed 0.17.5 is the pinned
version for this lineage; it does not have the 0.17.6 ZeRO-2 gradient-accumulation
defect, so the reported effective batch of 128 is the batch the optimizer actually saw.
The cosine schedule ran to its end (step 60,000 learning rate 2.278e-14, losses
0.0330 / 0.0344 / 0.0314 over the last three logged steps), and best_model_checkpoint is None
(no load-best-at-end), so checkpoint-60000 is the final model by construction.
--no-tune-llm --no-tune-visual resolve to tune_llm: false and tune_visual: false
in the run's own model config, and the runtime's startup log accordingly prints
Tune backbone llm: False / Tune backbone visual: False. But that same config also
carries tune_top_llm_layers: 4, and the runtime acts on it: besides the
diffusion/action head, the projector and the vision-language LayerNorm
(tune_vlln: true), it marks the top 4 layers of the language backbone trainable —
layers 12-15, the four immediately below select_layer: 16, where the projector reads
the backbone — and casts them to fp32 because backbone_trainable_params_fp32: true.
On a sibling run of this campaign with the same training runtime and the same launch
flags, that is 160 trainable parameter tensors, every one of them under
model.language_model.model.layers.{12,13,14,15}, and the runtime reports
Trainable parameters: 1,619,968,000 (49.29%). No vision-tower parameter appears in
that list, so the vision tower is genuinely frozen.
So the accurate statement is: the vision tower is frozen and the language backbone is frozen except for its top 4 layers, which are fine-tuned along with the projector, the vision-language LayerNorm and the diffusion/action head. This is the stock behavior of this runtime at these flags and is identical across the sibling checkpoints of this campaign, whose cards now state it in the same terms.
None of this has to be taken on trust: it is readable from this repository's own
config.json, which ships tune_llm: false, tune_visual: false,
tune_top_llm_layers: 4, select_layer: 16, tune_vlln: true,
tune_projector: true, tune_diffusion_model: true and
backbone_trainable_params_fp32: true.
ours_segment_film is an arm name, not an architecture changeThe run is labelled ours_segment_film in this campaign's ledgers (arm: ours). That
is the arm name, not a claim about a modified network: the deployed training runtime
is the same tree used by the sibling arms, and the network this repository ships is
stock GR00T N1.6 at the flags listed above. The Ours-specific part of the method lives
upstream, in how the mid-training parent's subtask segmentation was produced; this
fine-tuning stage is full-task-only and therefore consumes no segmentation at all.
Evaluation of this export on the publishing lab's RoboCasa365 target benchmark was in progress at publication time, so no success rate is reported here. No task-success or safety-performance claim is made by this model card.
| Repo | Role |
|---|---|
gr00t-n1.6-ours-racer-mt80k | the mid-training parent this run initializes from (job 47) |
gr00t-n1.6-ours-racer-ft-cs-sub60k | the subtask-conditioned low-level policy of the same arm on the composite-seen 16 split (needs a high-level planner) |
gr00t-n1.6-uvd-racer-mt80k-mix50 | UVD-RACER mid-training arm (job 12916) |
gr00t-n1.6-rdd-racer-mt80k-mix50 | RDD-RACER mid-training arm (job 13) |
gr00t-n1.6-uvd-racer-ft-at60k-fulltask | UVD-RACER full-task FT, 18 atomic-seen tasks |
gr00t-n1.6-rdd-racer-ft-at60k | RDD-RACER full-task FT, 18 atomic-seen tasks |
gr00t-n1.6-uvd-racer-ft-cs60k-fulltask | UVD-RACER full-task FT, 16 composite-seen tasks |
gr00t-n1.6-uvd-racer-ft-cu60k | UVD-RACER full-task FT, 16 composite-unseen tasks |
gr00t-n1.6-rdd-racer-ft-cu60k | RDD-RACER full-task FT, 16 composite-unseen tasks |
gr00t-n1.6-uvd-racer-pt120k-mix50 | longer-schedule UVD pretraining/mid-training sibling |
qwen3-vl-4b-uvd-racer-hl6k-cs16-final | the UVD arm's high-level subtask planner, composite-seen 16 |
qwen3-vl-4b-uvd-racer-hl6k-cu16-final | the UVD arm's high-level subtask planner, composite-unseen 16 |
gr00t-n1.6-mt60k-ds0175 | earlier mid-training checkpoint of the same lineage |
Published in the same batch: gr00t-n1.6-ours-racer-ft-at60k,
gr00t-n1.6-ours-racer-ft-cs60k, gr00t-n1.6-ours-racer-ft-cu60k and
gr00t-n1.6-rdd-racer-ft-cs-sub60k.
config.jsonprocessor_config.jsonstatistics.json (normalization statistics)embodiment_id.jsonOptimizer, scheduler, RNG state, training logs, internal experiment configs and training datasets are not included. This is a model export for inference or for starting a new fine-tuning run, not a complete optimizer-state resume bundle.
from huggingface_hub import snapshot_download
checkpoint_dir = snapshot_download(
"happyhappy-jun/gr00t-n1.6-ours-racer-ft-cs60k",
# revision=<commit sha of the single publication commit>
)
The whole payload is submitted in one atomic commit on a freshly created
repository, so that commit's sha is the only model revision here. It cannot be
written inside this file (the text would change the commit it names); the pinned
snapshot_download(..., revision=...) snippet is recorded in the publishing
lab's publication log alongside the per-file SHA-256 values.
Use this directory with compatible Isaac-GR00T N1.6 model/processor code.
The model type is Gr00tN1d6; ordinary Transformers AutoModel loading has not
been validated. The processor references nvidia/Eagle-Block2A-2B-v2, which may
require separate model access/download. The preserved processor includes a
RoboCasa new_embodiment modality configuration; use the matching embodiment,
three-camera layout (robot0_agentview_left, robot0_agentview_right,
robot0_eye_in_hand), state/action conventions and normalization statistics.
Because this arm was fine-tuned with full-task language only, condition it with the full task instruction, not a subtask instruction.
Upload verification covers source checksum identity, Safetensors/index structure and Hub file integrity. It is not a new GPU inference or robot rollout evaluation beyond the evaluation section above.
The underlying model is subject to the NVIDIA noncommercial license linked
by the upstream model card. A complete, unmodified copy is included as
LICENSE.pdf. The license restricts use to noncommercial research
or evaluation.
Attribution: NVIDIA Isaac GR00T N1.6 and its underlying components. This repository is an independent derivative checkpoint and is not endorsed by NVIDIA.
Validate in simulation and use appropriate robot safety controls before any physical deployment. Outputs are not guaranteed to be safe or correct.