Downloads · 30 days
15
16% of all-time downloads
monshinawatra/gr00t-n17-malkist-so101
gr00t-n17-malkist-so101 is a robotics model from monshinawatra. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for lerobot. The card lists the license as other.
Fine-tune of nvidia/GR00T-N1.7-3B for a tabletop pick-and-place task on the SO-101 follower arm: picking biscuit ("malkist") packs and placing them into a drawer box.
Downloads · 30 days
15
16% of all-time downloads
All-time downloads
93
Public
Parameters
3.1B
46.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.pt13 GB · 51%
From the Hugging Face model README
Fine-tune of nvidia/GR00T-N1.7-3B for a
tabletop pick-and-place task on the SO-101 follower arm: picking biscuit ("malkist")
packs and placing them into a drawer box.
nvidia/GR00T-N1.7-3B (~3B-param vision-language-action model)NEW_EMBODIMENT (SO-101 was not in GR00T pretraining)monshinawatra/malkist-picknplacePick all malkists and put them into the drawer box, then reset the arm to rest state.| Robot | SO-101 follower, 6-DoF (5 arm joints + gripper) |
| Cameras | front (third-person/overhead) + wrist, 640×480 RGB |
| State | 6-D absolute joint positions: shoulder_pan, shoulder_lift, elbow_flex, wrist_flex, wrist_roll, gripper |
| Action | 16-step chunk; arm = relative joint deltas, gripper = absolute target |
| Language | natural-language task instruction (see above) |
Camera note: the source dataset stores the third-person view as
observation.images.top; it is mapped to the model'sfrontinput viamodality.json. When deploying, register the overhead camera asfronton the client.
examples/SO100/so100_config.py) —
state/action single_arm (idx 0–5) + gripper (idx 5–6); video front + wrist.1. Start the policy server (GPU with 16 GB+ VRAM):
git clone https://github.com/NVIDIA/Isaac-GR00T.git && cd Isaac-GR00T && uv sync
uv run hf download monshinawatra/gr00t-n17-malkist-so101 --local-dir ./ckpt
uv run python gr00t/eval/run_gr00t_server.py \
--model-path ./ckpt \
--embodiment-tag NEW_EMBODIMENT \
--host 0.0.0.0 --port 5555
The checkpoint bundles experiment_cfg/ (modality config + dataset statistics), so no
--modality-config-path / --data-config is needed.
2. Run the client on the machine attached to the SO-101:
cd gr00t/eval/real_robot/SO100
uv run python eval_so100.py \
--robot.type=so101_follower \
--robot.port=/dev/ttyACM0 \
--robot.id=my_follower \
--robot.cameras="{ front: {type: opencv, index_or_path: 0, width: 640, height: 480, fps: 30}, wrist: {type: opencv, index_or_path: 2, width: 640, height: 480, fps: 30}}" \
--policy-host=<SERVER_IP> --policy-port=5555 \
--lang-instruction="Pick all malkists and put them into the drawer box, then reset the arm to rest state."
Open-loop sanity check against the dataset (no robot needed):
uv run python gr00t/eval/open_loop_eval.py \
--dataset-path <lerobot_v2.1_dataset> \
--embodiment-tag NEW_EMBODIMENT --model-path ./ckpt \
--traj-ids 0 --execution-horizon 16 --steps 400
Standard HF-format GR00T checkpoint: model-0000{1,2,3}-of-00003.safetensors +
model.safetensors.index.json, config.json, experiment_cfg/, embodiment_id.json,
statistics.json, plus training state (optimizer.pt, scheduler.pt, trainer_state.json)
for resuming.