Downloads · 30 days
0
herry12sf/breakout-dqn
breakout-dqn is a reinforcement learning model from herry12sf. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch.
Trained on ALE/Breakout-v5 using Vanilla DQN with vectorised environments.
Downloads · 30 days
0
Access
Public
Updated Jun 10, 2026
Repo size
20.4 MB
Likes
0
Public
Click a slice to open those files.
.pt20.2 MB · 99%
From the Hugging Face model README
Trained on ALE/Breakout-v5 using Vanilla DQN with vectorised environments.
| Property | Value |
|---|---|
| Environment | ALE/Breakout-v5 |
| State space | 4 × 84 × 84 stacked grayscale frames |
| Action space | 4 discrete (NOOP, FIRE, RIGHT, LEFT) |
| Frameskip | 4 |
The target network evaluates both action selection and value estimation:
next_q = q_target(next_state).max() # target picks AND evaluates
target_q = reward + γ * (1 - done) * next_q
| Parameter | Value |
|---|---|
| Global steps | 750,000 |
| Buffer size | 100,000 |
| Batch size | 64 |
| Parallel envs | 4 |
| Learning rate | 0.0001 |
| Discount (γ) | 0.99 |
| Target sync freq | 1000 |
| Grad clip norm | 10.0 |
| Epsilon start | 1.0 |
| Epsilon end | 0.01 |
import torch
model = DQN()
model.load_state_dict(torch.load('best_breakout.pt')['model'])
model.eval()