Downloads · 30 days
0
yonghoon96/trqam-bc-checkpoints
trqam-bc-checkpoints is a reinforcement learning model from yonghoon96. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for jax. The card lists the license as mit.
Behavior-cloning flow policies for the ten OGBench domains used in Trust Region Q Adjoint Matching (TRQAM). Each checkpoint is the pretrained flow that TRQAM and the flow-based baselines are initialised from.
Downloads · 30 days
0
Access
Public
Updated Oct 7, 2026
Repo size
72.2 MB
Likes
0
Public
Click a slice to open those files.
.pkl72.2 MB · 100%
From the Hugging Face model README
Behavior-cloning flow policies for the ten OGBench domains used in Trust Region Q Adjoint Matching (TRQAM). Each checkpoint is the pretrained flow that TRQAM and the flow-based baselines are initialised from.
Paper: Trust Region Q Adjoint Matching (NeurIPS 2026)
| folder | dataset | actor | action chunk |
|---|---|---|---|
antmaze-large-navigate | antmaze-large-navigate-v0 (1M) | 512 x 4 | 1 |
antmaze-giant-navigate | antmaze-giant-navigate-10m-v0 (10M) | 1024 x 4, layer norm | 1 |
humanoidmaze-medium-navigate | humanoidmaze-medium-navigate-v0 (1M) | 512 x 4 | 1 |
humanoidmaze-large-navigate | humanoidmaze-large-navigate-v0 (1M) | 512 x 4 | 1 |
scene-play | scene-play-v0 (1M) | 512 x 4 | 5 |
puzzle-3x3-play | puzzle-3x3-play-v0 (1M) | 512 x 4 | 5 |
puzzle-4x4-play | puzzle-4x4-play-100m-v0, shards 000-009 (10M) | 1024 x 4, layer norm | 5 |
cube-double-play | cube-double-play-v0 (1M) | 512 x 4 | 5 |
cube-triple-play | cube-triple-play-100m-v0, shards 000-009 (10M) | 1024 x 4, layer norm | 5 |
cube-quadruple-play | cube-quadruple-play-100m-v0 (100M) | 1024 x 4, layer norm | 5 |
The folder names carry no dataset size. Four domains are trained on datasets larger than the OGBench default, as the table shows. The 10M puzzle-4x4 and cube-triple datasets are the first ten 1M shards of the corresponding 100M datasets.
All checkpoints are trained for 300K steps with seed 10001, 10 flow steps, and a batch of 256. BC
uses no reward, so a checkpoint serves every task of its domain. config.json in each folder records
the full agent configuration and the environment the run was launched with.
Each params_300000.pkl holds only the BC flow, at the key TRQAM's loader reads:
{"agent": {"network": {"params": {"modules_actor_slow": ...}}}}
Pass it to TRQAM's main.py as --pretrained_actor_path, together with the domain's network
configuration from the table (--agent.actor_hidden_dims, --agent.actor_layer_norm,
--horizon_length). TRQAM's --horizon_length defaults to 5, so the navigation domains need
--horizon_length=1. The loader copies the flow into every actor slot of the agent.
The weights are plain numpy arrays, so the files load with NumPy 1.x or 2.x and any JAX version. Optimizer state, critics and target networks are not included.
@inproceedings{dong2026trqam,
author = {Yonghoon Dong and Kyungmin Lee and Changyeon Kim and Jaehyuk Kim and Jinwoo Shin},
title = {Trust Region Q Adjoint Matching},
booktitle = {Advances in Neural Information Processing Systems},
year = {2026}
}