Downloads · 30 days
4
17% of all-time downloads
ppo-LunarLander-v2-unit8
hamim-87/ppo-LunarLander-v2-unit8
ppo-LunarLander-v2-unit8 is a reinforcement learning model from hamim-87. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product.
This is my Hugging Face Deep Reinforcement Learning Course Unit 8 Part 1 submission. The PPO agent was implemented from scratch with PyTorch and trained on the exact course environment, LunarLander-v2.
All-time downloads
24
Public
Repo size
286 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.mp4241 KB · 83%
At a glance
- Task
- Reinforcement Learning
- Access
- Public
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026
- SHA
- c39b9dda
Model card
From the Hugging Face model README
PPO Agent Playing LunarLander-v2
This is my Hugging Face Deep Reinforcement Learning Course Unit 8 Part 1 submission.
The PPO agent was implemented from scratch with PyTorch and trained on the exact
course environment, LunarLander-v2.
Evaluation
- Mean reward: -76.70
- Standard deviation: 25.91
- Episodes: 20
Hyperparameters
{
"env_id": "LunarLander-v2",
"seed": 1,
"total_timesteps": 500000,
"learning_rate": 0.0003,
"num_envs": 8,
"num_steps": 256,
"num_minibatches": 8,
"update_epochs": 4,
"gamma": 0.99,
"gae_lambda": 0.95,
"clip_coef": 0.2,
"ent_coef": 0.01,
"vf_coef": 0.5,
"max_grad_norm": 0.5,
"anneal_lr": true,
"norm_adv": true,
"clip_vloss": true,
"target_kl": 0.03,
"save_every_updates": 20,
"resume": true
}
- Task
- Reinforcement Learning
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026