Downloads · 30 days
5
12% of all-time downloads
TheBestMoldyCheese/ppo-LunarLander-v2-from-scratch
ppo-LunarLander-v2-from-scratch is a reinforcement learning model from TheBestMoldyCheese. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product.
Trained with a CleanRL-style single-file PPO implementation as part of the Hugging Face Deep RL Course — Unit 8.
Downloads · 30 days
5
12% of all-time downloads
All-time downloads
41
Public
Repo size
318 KB
Likes
0
Public
Click a slice to open those files.
.mp4128 KB · 73%
From the Hugging Face model README
Trained with a CleanRL-style single-file PPO implementation as part of the Hugging Face Deep RL Course — Unit 8.
| Metric | Value |
|---|---|
| Mean reward | 133.84 ± 73.67 |
| Eval episodes | 10 |
| Parameter | Value |
|---|---|
| total_timesteps | 500000 |
| learning_rate | 0.00025 |
| num_envs | 4 |
| num_steps | 128 |
| gamma | 0.99 |
| gae_lambda | 0.95 |
| clip_coef | 0.2 |
| ent_coef | 0.01 |
| vf_coef | 0.5 |
| update_epochs | 4 |
| num_minibatches | 4 |