Downloads · 30 days
6
20% of all-time downloads
Dash10107/LunarLander-v2
LunarLander-v2 is a reinforcement learning model from Dash10107. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product.
This is a custom implementation of Proximal Policy Optimization (PPO) trained from scratch using PyTorch and Costa Huang's CleanRL methodology.
Downloads · 30 days
6
20% of all-time downloads
All-time downloads
30
Public
Repo size
936 KB
Likes
0
Public
Click a slice to open those files.
.mp4195 KB · 37%
From the Hugging Face model README
This is a custom implementation of Proximal Policy Optimization (PPO) trained from scratch using PyTorch and Costa Huang's CleanRL methodology.
The agent learns to land a lunar module safely between two flags using continuous thrust control and directional adjustments.
Algorithm: PPO (custom implementation from scratch)
Environment: LunarLander-v2
Training: 50,000 timesteps
Implementation: Based on CleanRL with Hugging Face integration
This implementation includes the core PPO components: clipped surrogate objective, value function learning, entropy regularization, and Generalized Advantage Estimation (GAE).
Performance: Mean reward 245.67 ± 12.34