Downloads · 30 days
0
gangweix/next-forcing-base
next-forcing-base is a robotics model from gangweix. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for diffusers. The card lists the license as apache-2.0.
Base checkpoint for Next Forcing: Causal World Modeling with Multi-Chunk Prediction. This is the causal video-action backbone used as the initialization for post-training.
Downloads · 30 days
0
Access
Public
Updated Aug 16, 2026
Parameters
5.1B
24.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors24.4 GB · 100%
From the Hugging Face model README
Base checkpoint for Next Forcing: Causal World Modeling with Multi-Chunk Prediction. This is the causal video-action backbone used as the initialization for post-training.
gangweix/next-forcing-posttrain-robotwinNext Forcing addresses the myopic supervision problem in autoregressive video world models: next-chunk denoising tends to learn local appearance shortcuts instead of long-range dynamics, especially at high frame rates. Lightweight Multi-Chunk Prediction (MCP) modules predict multiple future chunks through a causal chain during training, providing dense temporal supervision to the backbone.
This base checkpoint contains the backbone without MCP modules. The MCP
modules are created at the start of post-training and initialized from the last
mcp_blocks_per_depth backbone blocks (mcp_init_from_backbone = True), so the
post-trained checkpoint is correspondingly larger (6.7B vs 5.1B).
| Parameters | 5.1B (BF16) |
| Backbone layers | 30 |
| MCP modules | Not included (added during post-training) |
Built on top of the LingBot-VA codebase.
transformer/ Causal video-action backbone
vae/
text_encoder/
tokenizer/
Clone the code and install the dependencies as described in the repository README.
python -m pip install "huggingface_hub[cli]"
hf download gangweix/next-forcing-base \
--local-dir ./checkpoints/next-forcing-base
The training code resolves model subfolders by path, so point
NEXT_FORCING_PRETRAINED_MODEL_PATH at the local directory, not at the Hub
repository id:
export NEXT_FORCING_PRETRAINED_MODEL_PATH=$PWD/checkpoints/next-forcing-base
export NEXT_FORCING_DATASET_PATH=/path/to/your/dataset
export NEXT_FORCING_SAVE_ROOT=/path/to/your/output
NGPU=8 CONFIG_NAME=robotwin_train \
bash script/run_va_posttrain.sh --init-worker 1
MCP defaults (wan_va/configs/mcp_train_config.py): num_mcp_depths = 3,
mcp_blocks_per_depth = 3, mcp_hidden_collect_layers = [3, 11, 19, 29],
mcp_loss_weights = [0.5, 0.2, 0.1].
Released under the Apache License 2.0. Next Forcing is developed on top of the LingBot-VA codebase; please retain the upstream attribution and license when redistributing.
@article{xu2026next,
title={Next Forcing: Causal World Modeling with Multi-Chunk Prediction},
author={Xu, Gangwei and Zhang, Qihang and Zhou, Jiaming and Zhu, Xing and Shen, Yujun and Yang, Xin and Xu, Yinghao},
journal={arXiv preprint arXiv:2606.11187},
year={2026}
}