Downloads · 30 days
0
ppo-CartPole-v1
cjksofm/ppo-CartPole-v1
ppo-CartPole-v1 is a reinforcement learning model from cjksofm. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product.
This is a trained model of a PPO agent playing CartPole-v1.
Access
Public
Updated Jun 8, 2026
Repo size
394 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.1151 KB · 37%
At a glance
- Task
- Reinforcement Learning
- Access
- Public
- Created
- Jun 8, 2026
- Updated
- Jun 8, 2026
- SHA
- 174350b7
Model card
From the Hugging Face model README
PPO Agent Playing CartPole-v1
This is a trained model of a PPO agent playing CartPole-v1.
Hyperparameters
exp_name: ppo_cartpole
seed: 1
torch_deterministic: True
cuda: True
track: False
wandb_project_name: cleanRL
wandb_entity: None
capture_video: False
env_id: CartPole-v1
total_timesteps: 50000
learning_rate: 0.00025
num_envs: 4
num_steps: 128
anneal_lr: True
gae: True
gamma: 0.99
gae_lambda: 0.95
num_minibatches: 4
update_epochs: 4
norm_adv: True
clip_coef: 0.2
clip_vloss: True
ent_coef: 0.01
vf_coef: 0.5
max_grad_norm: 0.5
target_kl: None
repo_id: cjksofm/ppo-CartPole-v1
batch_size: 512
minibatch_size: 128
- Task
- Reinforcement Learning
- Created
- Jun 8, 2026
- Updated
- Jun 8, 2026