Downloads · 30 days
38
12% of all-time downloads
Hanks1234/battleship-ppo-phase5b
battleship-ppo-phase5b is a reinforcement learning model from Hanks1234. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for stable-baselines3.
Best checkpoint from Mar 21 autoresearch session (50 experiments).
Downloads · 30 days
38
12% of all-time downloads
All-time downloads
314
Public
Repo size
15.8 MB
Likes
0
Public
Click a slice to open those files.
.zip15.2 MB · 96%
From the Hugging Face model README
Best checkpoint from Mar 21 autoresearch session (50 experiments).
| Metric | Value |
|---|---|
| eval/mean_shots | 106.9 |
| previous_best | 109.6 |
| improvement | 2.7 shots |
| Parameter | Value |
|---|---|
| lr_schedule | linear |
| n_epochs | 2 |
| lr | 1e-5 |
| clip_range | 0.05 |
| ent_coef | 0.002 |
| ent_coef_final | 0.0002 |
| n_envs | 4 |
| n_steps | 128 |
| batch_size | 128 |
| gamma | 0.995 |
| reward_preset | efficiency_v2_infogain |
| seed | 51 |
| device | cuda (RTX 5070 Ti) |
| time_budget | 30min |