Downloads · 30 days
8
28% of all-time downloads
micahr234/mouse-example-model-aug
mouse-example-model-aug is a reinforcement learning model from micahr234. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for mouse-core.
This repository contains a MOUSE model checkpoint.
Downloads · 30 days
8
28% of all-time downloads
All-time downloads
29
Public
Repo size
1.8 GB
Likes
0
Public
Click a slice to open those files.
.bin1.8 GB · 100%
From the Hugging Face model README
This repository contains a MOUSE model checkpoint.
qwen31024action_valueaction_valueStepEmbedder reads flat step-record dicts and projects each declared modality
into the shared 1024-dimensional token space before the
backbone.
| Field | Type | Required | Tensor shape | Dtype | Notes |
|---|---|---|---|---|---|
action | discrete | yes | [B, S] | torch.long | integer ids in [0, 3] |
observation | discrete | yes | [B, S] | torch.long | integer ids in [0, 63] |
reward | rff | yes | [B, S] | torch.float32 | scalar value |
done | discrete | yes | [B, S] | torch.long | integer ids in [0, 4] |
| - | learnable | no | not read from step_stream | n/a | learned tokens; no input field |
pip install mouse-core
import torch
from mouse_core import load_model
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = load_model("micahr234/mouse-example-model-aug", map_location="cpu").eval().to(device)
The model accepts a list[list[dict]] batch of shape [B][S] — B sequences,
each containing S step-record dicts with flat keys matching the encoder's
declared modalities above.
# Batch shape: [B=1][S=1] — one sequence of one step.
batch = [[
{
"action": 0,
"observation": 0,
"reward": 0.0,
"done": 0,
}
]]
predictions, objective_data, cache = model(batch)
with torch.no_grad():
predictions, _, cache = model(batch)
action = model.get_action(predictions, temperature=0.0)
model() returns (predictions, objective_data, cache). objective_data is a
TensorDict[B, S] of the modality tensors extracted by the encoder — pass it
to objectives during training. For cached one-step rollout, keep cache and
pass it back on the next call with use_cache=True.