Downloads · 30 days
0
CartPole-v1_ppo
tsilva/CartPole-v1_ppo
CartPole-v1_ppo is a reinforcement learning model from tsilva. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
Run: cvb5lyfw — Env: CartPole-v1 — Algo: ppo
Access
Public
Updated Aug 16, 2025
Repo size
521 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.mp4849 KB · 64%
At a glance
- Task
- Reinforcement Learning
- Library
- pytorch
- License
- mit
- Access
- Public
- Created
- Aug 16, 2025
- Updated
- Aug 16, 2025
- SHA
- f1f43403
Model card
From the Hugging Face model README
CartPole-v1_ppo
Run: cvb5lyfw — Env: CartPole-v1 — Algo: ppo
This repository contains artifacts from a Gymnasium Solver training run.
Contents
- Config:
artifacts/configs/config.json - Checkpoints:
artifacts/checkpoints/*.ckpt - Logs:
artifacts/logs/*.log - Video:
artifacts/videos/**/best_checkpoint.mp4(also previewed below)
Preview
<video controls src="preview.mp4" width="480"></video>
If the video above doesn't load, try the fallback: replay.mp4
Config (excerpt)
{
"env_id": "CartPole-v1",
"algo_id": "ppo",
"n_steps": 32,
"batch_size": 256,
"n_epochs": 20,
"n_timesteps": 100000.0,
"seed": 42,
"n_envs": 8,
"obs_type": "rgb",
"policy": "MlpPolicy",
"learning_rate": 0.001,
"gamma": 0.98,
"gae_lambda": 0.8,
"ent_coef": 0.0,
"vf_coef": 0.5,
"clip_range": 0.2,
"normalize_advantages": "batch"
}
- Task
- Reinforcement Learning
- Library
- pytorch
- License
- mit
- Languages
- en
- Created
- Aug 16, 2025
- Updated
- Aug 16, 2025