g1-imitate-isaaclab-amp

G1 Humanoid Motion Imitation (AMP) - Step 2 Physics Calibration

Reinforcement learning policy for the Unitree G1 humanoid robot to imitate 494 human motion capture sequences from the AMASS dataset, trained using Adversarial Motion Priors (AMP) in Isaac Lab.

This is the Step 2 (Physics Calibration) checkpoint — pure tracking mode with curriculum domain randomization, before style injection.

Model Details

Performance (Best Checkpoint)

Tracking Reward

The tracking reward is an exponential kernel (exp(-error / 0.2)) over a weighted combination of pose errors. Range is 0.0 (poor) to 1.0 (perfect match).

The instantaneous reward mean of ~0.40 indicates the policy tracks the average motion with reasonable fidelity across all 494 diverse motions. The max of ~0.60 shows strong tracking on easier motions.

Architecture

• Policy: Gaussian MLP (1024 → 512 → 23), fixed log_std = -2.9
• Value: Deterministic MLP (1024 → 512 → 1)
• Discriminator: Deterministic MLP (1024 → 512 → 1) with ELU (disabled in Step 2)
• Observation Space: 216 dimensions (joint pos/vel, root state, future reference targets)
• Action Space: 23 dimensions (joint position targets, scaled by 0.5)

Training Configuration

• Environments: 1024 parallel
• Rollouts: 16 steps
• Learning Rate: 2.5e-5
• Discount Factor: 0.99
• GAE Lambda: 0.95
• Mini-batches: 2
• Learning Epochs: 6
• PPO Clip: 0.2
• Physics dt: 0.005s (200Hz), decimation=4, 50Hz control

Domain Randomization (Curriculum)

Linearly interpolated from initial to target ranges over 240k iterations:

Reward Weights

Tracking Metric Weights

Usage

Evaluation

# Inside Isaac Lab Docker container
cd /workspace/isaaclab
/isaac-sim/python.sh scripts/reinforcement_learning/skrl/play.py \
    --task Isaac-Humanoid-Amass-Step2-PhysicsCalibration-v0 \
    --algorithm AMP --num_envs 16 \
    --checkpoint /path/to/best_agent.pt

Record Video

/isaac-sim/python.sh scripts/reinforcement_learning/skrl/play.py \
    --task Isaac-Humanoid-Amass-Step2-PhysicsCalibration-v0 \
    --algorithm AMP --num_envs 16 \
    --checkpoint /path/to/best_agent.pt \
    --video --video_length 500

Resume Training

/isaac-sim/python.sh scripts/reinforcement_learning/skrl/train.py \
    --task Isaac-Humanoid-Amass-Step2-PhysicsCalibration-v0 \
    --algorithm AMP --num_envs 1024 --headless \
    --checkpoint /path/to/best_agent.pt

Files

├── best_agent.pt          # Full checkpoint — policy + value + discriminator + optimizer (25 MB)
├── policy_jit.pt          # JIT-traced policy only — for deployment/inference (2.9 MB)
├── params/
│   ├── agent.yaml         # skrl agent configuration
│   └── env.yaml           # Environment configuration
└── README.md              # This model card

JIT Model

policy_jit.pt is a TorchScript-traced policy network (input: 216-dim observation, output: 23-dim joint targets). It runs without skrl or Isaac Lab dependencies:

import torch
model = torch.jit.load("policy_jit.pt")
obs = torch.randn(1, 216)  # [batch, obs_dim]
actions = model(obs)        # [batch, 23] — joint position targets (scale by 0.5)

Use best_agent.pt to resume training. Use policy_jit.pt for deployment or sim-to-real transfer.

Three-Step Training Strategy

This checkpoint is from Step 2 of a three-step curriculum:

Citation

@misc{pathonai2026g1imitate,
  title={G1 Humanoid Motion Imitation with AMP in Isaac Lab},
  author={PathOn-AI},
  year={2026},
  publisher={Hugging Face},
  url={https://huggingface.co/PathOn-AI/g1-imitate-isaaclab-amp}
}

License

MIT