Downloads · 30 days
0
0% of all-time downloads
wam_ctxcomp_stage1
hmkang/wam_ctxcomp_stage1
wam_ctxcomp_stage1 is a robotics model from hmkang. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for wan2.2. The card lists the license as other.
Stage-1 of the context compressor for WAMDIT4DIT (Wan2.2-TI2V-5B video DiT). It compresses T context latent frames into N motion tokens via an inverse-dynamics (IDM) head + skip-reconstruction losses. The 5B video DiT…
All-time downloads
36
Public
Repo size
2.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.8 GB · 100%
At a glance
- Task
- Robotics
- Library
- wan2.2
- License
- other
- Access
- Public
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026
- SHA
- 331bdc2c
Model card
From the Hugging Face model README
WAM_DIT4DIT — Stage-1 Context Compressor (RoboCasa)
Stage-1 of the context compressor for WAM_DIT4DIT (Wan2.2-TI2V-5B video DiT). It compresses T context latent frames into N motion tokens via an inverse-dynamics (IDM) head + skip-reconstruction losses. The 5B video DiT is frozen; only the ~compressor trains. Trained on RoboCasa (robocasa_mg_gr00t_300), T=4, 25k steps.
Weights only — model.safetensors + config. The deepspeed optimizer state
(global_step*, 28 GB) and resume artifacts are omitted; these are not needed to
load the compressor.
Variants (each in its own subfolder)
| subfolder | config | train metrics @ 25k (normalized, <1 = working) |
|---|---|---|
orig/ | motion_dim=192, attn pool (baseline) | recon_rel 0.045 / idm_rel 0.158 |
mdimnone/ | motion_dim=None (384, identity) | recon_rel 0.012 / idm_rel 0.268 |
encspatial/ | enc_spatial_mix on (mdim192, attn) | recon_rel 0.039 / idm_rel 0.061 |
Metrics are training values (not held-out eval).
Load
from huggingface_hub import snapshot_download
path = snapshot_download("hmkang/wam_ctxcomp_stage1", allow_patterns="encspatial/*")
- Task
- Robotics
- Library
- wan2.2
- License
- other
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026