Kairos3.1-4B-robot-480P

Kairos

<p align="center"> <img src="assets/logo_kairos.png" width="500"/> </p> <p align="center"> 💜 <a href="https://kairos.acerobotics.com">Kairos Platform</a> &nbsp&nbsp ｜ &nbsp&nbsp 🖥️ <a href="https://github.com/kairos-agi">GitHub</a> &nbsp&nbsp | &nbsp&nbsp🤗 <a href="https://huggingface.co/collections/kairos-agi/kairos30">Hugging Face</a>&nbsp&nbsp | &nbsp&nbsp🤖 <a href="https://modelscope.cn/collections/kairos-team/kairos30">Model Scope</a>&nbsp&nbsp| &nbsp&nbsp 📑 <a href="https://arxiv.org/abs/2606.16533">Paper</a> &nbsp&nbsp </p>

---

Kairos is a 4B-parameter native cross-embodiment world model for unified understanding, generation, and action prediction. Through a progressive Cross-Embodiment Data Curriculum, it learns from general videos, human behavior, and real-robot interaction to build persistent world representations. Powered by a World-Action Model architecture and hybrid linear temporal memory, Kairos jointly predicts future visual states and executable robot actions, enabling long-horizon reasoning, high-quality generation, and real-time edge-side deployment for embodied AI.

🔥 0. Latest News

Jul 2, 2026: 🛠️ We've open-sourced the Kairos3.1 series, including World-Action Model inference code and three model weights: Kairos3.1-4B-robot-480P, kairos-4B-robot-RoboTwin2.0, and kairos-4B-robot-LIBERO-plus. RoboTwin 2.0 and LIBERO-Plus support executable action prediction.

Jun 16, 2026: 📄 We've released the Kairos technical report on arXiv: Kairos Technical Report.

Feb 26, 2026: 👋 We've released Kairos video world model weights, including kairos-robot-4B-480P, kairos-robot-4B-480P-distilled, and kairos-4B-720P.

Dec 18, 2025: 🎉 Kairos 3.0 was officially introduced, along with the Kairos World Model inference code and kairos-4B-480P-pretrained.

🚀 1. Motivation

Embodied AI is entering the era of Scaling Laws, yet scaling alone cannot overcome the core barriers to reliable real-world interaction. Heterogeneous embodiment data, weak long-horizon reasoning, separated video-and-action modeling, and edge-side compute constraints still limit the practicality of current world models. Kairos addresses these challenges by unifying cross-embodiment pretraining, persistent world-state modeling, future generation, and executable action prediction within an efficient deployment-aware framework.

🌟 2. Kairos Framework

<div align="center"> <table align="center"> <tr> <td align="center"><img src="assets/framework_new_v1.png" height="256"/></td> <td align="center"><img src="assets/kairos_arch1.jpg" height="256"/></td> <td align="center"><img src="assets/architecture_kairos.png" height="256"/></td> </tr> </table> </div>

🌍 Native Pretraining Paradigm with Cross-Embodiment Data Curriculum

Kairos introduces a native world-model pretraining paradigm that learns physical, behavioral, and embodied knowledge from scratch, rather than relying on decoupled post-training adaptation. Through a Cross-Embodiment Data Curriculum (CEDC), the model progressively absorbs knowledge from general videos, human behavior data, and real-robot interaction data. This curriculum enables Kairos to move beyond flat data scaling, building world representations that evolve from passive physical understanding to active task intent and embodied control.

🔗 Unified Understanding–Generation–Prediction Architecture

Kairos is designed as a native end-to-end architecture for understanding, generating, and predicting the world within a unified Mixture-of-Transformers framework. Instead of treating world modeling as simple video continuation, Kairos maintains persistent world states, where understanding provides causal interpretation, generation unfolds plausible futures, and prediction produces executable robot actions. This unified design allows the model to connect perception, reasoning, planning, and action in a single intelligence loop.

⚡ Hybrid Linear Temporal Memory for Efficient Deployment

Kairos introduces a hybrid linear temporal memory mechanism for long-horizon world modeling. By combining Sliding-Window Attention, Dilated Sliding-Window Attention, and Gated Linear Attention, the model captures local dynamics, mid-range interactions, and global causal memory under linear-complexity temporal modeling. Together with deployment-aware system co-design, including efficient kernels, quantization, and token streaming, Kairos supports low-memory, high-throughput inference and lays the foundation for real-time closed-loop deployment.

✨ 3. Demos

<div align="center"> <table style="text-align: center; margin: 0 auto;"> <thead> <tr> <th style="text-align: center;">Physical–causal consistency</th> <th style="text-align: center;">Cross-embodiment generalization</th> <th style="text-align: center;"> Accurate Action Prediction </th> <th style="text-align: center;">High-efficiency inference</th> </tr> </thead> <tbody> <tr> <td style="text-align: center;"><img src="assets/videos/physical-1.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/cross-1.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/robotwin_demo_1.gif" width="240"/></td> <td style="text-align: center;" rowspan="3"><img src="assets/videos/hpc.gif" width="240"/></td> </tr> <tr> <td style="text-align: center;"><img src="assets/videos/physical-2.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/cross-2.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/robotwin_demo_2.gif" width="240"/></td> </tr> <tr> <td style="text-align: center;"><img src="assets/videos/physical-3.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/cross-3.gif" width="240"/></td> <td style="text-align: center;"><img src="assets/videos/libero_plus_demo_1.gif" width="240"/></td> </tr> </tbody> </table> </div>

🧠 Physical–causal consistency

Kairos leverages causal CoT and physical laws to transform multimodal inputs into deep task logic. It enables autonomous planning and feasibility analysis, shifting the system from "executing commands" to "understanding intent" for real-world robotic actions.

🎨 Cross-embodiment generalization

Unified Cross-Embodiment Generation: A single "brain" that generalizes across single-arm, dual-arm, and dexterous-hand platforms. Kairos enables shared, transferable world knowledge with maximal adaptability. Broad Hardware Support: Native compatibility with Agibot G1, Unitree G1, and Songling PIPER, significantly slashing development costs through zero-shot multi-task generalization.

🎯 Accurate Action Prediction

Powered by its World-Action Model, Kairos predicts executable robot action trajectories directly from visual observations and task context. This enables accurate, temporally coherent, and physically grounded action generation for long-horizon embodied manipulation.

🔮 High-efficiency inference

Real-time Edge Performance: Industry-leading inference speed with ultra-low resource consumption. Optimized for low-latency, high-reliability deployment across single or multi-GPU embodied systems.

📦 4. Model Zoo

📈 5. Evaluation

🎯 5.1 Accuracy Benchmarks

<div align="center"> <table align="center"> <tr> <!-- 左边一列 --> <td align="center"> <img src="assets/evals/eval_worldmodel_bench_robot_new.png" height="350px" alt="worldmodel_bench"><br> </td> <!-- 右边一列 --> <td align="center"> <img src="assets/evals/eval_dreamgen.png" height="350px" alt="dreamgen"><br> </td> </tr> <tr> <td colspan="2" align="center"> <strong>Performance comparison across embodied world model benchmarks</strong> </td> </tr> </table> </div> <div align="center"> <table align="center"> <tr> <!-- 左边一列 --> <td align="center"> <img src="assets/evals/eval_robotwin2.0.png" height="350px" alt="eval_robotwin2.0"><br> </td> <!-- 右边一列 --> <td align="center"> <img src="assets/evals/eval_libero_plus.png" height="350px" alt="eval_libero_plus"><br> </td> </tr> <tr> <td colspan="2" align="center"> <strong>Performance comparison across world action model benchmarks</strong> </td> </tr> </table> </div>

⚡ 5.2 Deployment

5.2.1 Real-time Inference

*(results based on kairos-4B-robot 480p distillation)

5.2.2 Benchmark for A800 GPU

*（evaluation setting：TI2V mode with 720P/5s）

🔧 6. Quick Start

6.1 Environment Installation

# Clone the repository
git clone https://github.com/kairos-agi/kairos-sensenova.git
cd kairos-sensenova

# You can set up the environment in two ways:
# 1) Build container from the Docker image
# 2) Build the environment from requirements with conda or venv

# 1) Docker image:
# Note:
# Please select the Docker image that matches your GPU platform.
# The default image is for A800 / A100, while RTX 5090 requires the -rtx5090 image tag, and METAX C500 requires the -metax tag.

# Pull the Docker image
# For A800 / A100
echo "$GHCR_TOKEN" | docker login ghcr.io -u username --password-stdin
docker pull ghcr.io/kairos-agi/kairos-sensenova:v0.0.1

# For RTX 5090
# docker pull ghcr.io/kairos-agi/kairos-sensenova:v0.0.1-rtx5090

# For METAX C500
# docker pull ghcr.io/kairos-agi/kairos-sensenova:v0.0.1-metax

# Create a container using Docker
docker run --rm -it \
  --gpus all \
  -v $(pwd):/workspace \
  ghcr.io/kairos-agi/kairos-sensenova:v0.0.1 \
  bash

# For RTX 5090
# docker run --rm -it \
#   --gpus all \
#   -v $(pwd):/workspace \
#   ghcr.io/kairos-agi/kairos-sensenova:v0.0.1-rtx5090 \
#   bash

# For METAX C500
# docker run --rm -it \
#   --gpus all \
#   -v $(pwd):/workspace \
#   ghcr.io/kairos-agi/kairos-sensenova:v0.0.1-metax \
#   bash

# 2) Requirements
# build a python environment with python>=3.10, torch>=2.6, and cuda>=12.6
# install requirements
# Note: METAX C500 is not supported in this setup method. For METAX C500, please use the Docker image only.
pip install -r requirements.txt

6.2 Download Kairos Models

• Download with huggingface

pip install -U huggingface_hub 

# 4B-480P
hf download kairos-agi/Kairos3.1-4B-robot-480P \
  --local-dir models/Kairos-model/kairos-agi/Kairos3.1-4B-robot-480P

# 4B-720P
hf download kairos-agi/kairos-sensenova-4B-720P \
  --local-dir models/Kairos-model/kairos-agi/kairos-sensenova-4B-720P 

# 4B-robot-RoboTwin2.0
hf download kairos-agi/kairos-4B-robot-RoboTwin2.0 \
  --local-dir models/Kairos-model/kairos-agi/kairos-4B-robot-RoboTwin2.0

# 4B-robot-LIBERO-plus
hf download kairos-agi/kairos-4B-robot-LIBERO-plus \
  --local-dir models/Kairos-model/kairos-agi/kairos-4B-robot-LIBERO-plus

• Download with modelscope

pip install modelscope

# 4B-480P
modelscope download kairos-team/Kairos3.1-4B-robot-480P \
  --local_dir models/Kairos-model/kairos-agi/kairos-team/Kairos3.1-4B-robot-480P 

# 4B-720P
modelscope download kairos-team/kairos-sensenova-4B-720P \
  --local_dir models/Kairos-model/kairos-agi/kairos-sensenova-4B-720P 

# 4B-robot-RoboTwin2.0
modelscope download kairos-team/kairos-4B-robot-RoboTwin2.0 \
  --local_dir models/Kairos-model/kairos-agi/kairos-4B-robot-RoboTwin2.0

# 4B-robot-LIBERO-plus
modelscope download kairos-team/kairos-4B-robot-LIBERO-plus \
  --local_dir models/Kairos-model/kairos-agi/kairos-4B-robot-LIBERO-plus

6.3 Run Inference

# Note: Please complete Section 6.2 first to download the Kairos model weights.

# Step1: Download additional dependencies for inference
mkdir -p models/Qwen models/Wan2.1-T2V-14B

# Download Qwen2.5-VL for Text-Encoder
hf download Qwen/Qwen2.5-VL-7B-Instruct-AWQ \
  --local-dir models/Qwen/Qwen2.5-VL-7B-Instruct-AWQ \
  --include "*.safetensors"  

hf download Qwen/Qwen3.5-2B \
  --local-dir models/Qwen/Qwen3.5-2B

# Download Wan2.1-VAE for VAE-Encoder/Decoder
hf download Wan-AI/Wan2.1-T2V-14B \
  --local-dir models/Wan2.1-T2V-14B \
  --include "Wan2.1_VAE.pth"  

# Step2: Run the examples
# The example JSON files provided here are intended for the
# `kairos-sensenova-robot-4B-480P-distilled` model.
#
# For TI2V and I2V, please use the 480P JSON configs. This distilled model is
# optimized for 480P, and its performance at 720P is not ideal.
#
# For other models and the matching configs, please refer to `docs/QUICKSTART.md`.

# kairos-4B-720p
# Text2Video
bash examples/inference.sh examples/example_t2v.json kairos/configs/kairos_4b_config.py
# Text&FirstImage2Video
bash examples/inference.sh examples/example_ti2v.json kairos/configs/kairos_4b_config.py
# FirstImage2Video
bash examples/inference.sh examples/example_i2v.json kairos/configs/kairos_4b_config.py

# kairos-team/Kairos3.1-4B-robot-480P
# Text&FirstImage2Video
bash examples/inference.sh examples/example_ti2v_480P_robot_1.json kairos/configs/kairos_4b_video_only_config.py
bash examples/inference.sh examples/example_ti2v_480P_robot_2.json kairos/configs/kairos_4b_video_only_config.py

6.4 Run Inference in Simulation Environments

We provide benchmark-specific instructions and evaluation scripts for the following embodied AI benchmarks.

👥 7. About Us

Developed and maintained by the Kairos Team. We specialize in Embodied Intelligence and World Model research, with a mission to build Artificial General Intelligence (AGI) that truly understands the physical world. Our goal is to accelerate the industrialization of embodied technologies and reshape the global landscape of AI competition.

📄 8. License

Kairos is open-sourced under the Apache License 2.0. Feel free to use, modify, and build commercial products on top of it. Check the LICENSE file for the full text.

📚 9. Citation

If you find our work helpful, please cite us.

@misc{kairosteam2026kairosregretawarenativeworldaction,
      title={Kairos: A Regret-Aware Native World-Action Model Stack for Physical AI}, 
      author={Kairos Team and Fei Wang and Shan You and Qiming Zhang and Tao Huang and Zuoyi Fu and Zhisheng Zheng and Yunlong Xi and Feng Lv and Xiaoming Wu and Zeyu Liu and Cong Wan and Pu Li and Ruiqing Yang and Xiaoou Li and Wei Wang and Kangkang Zhu and Yuwei Zhang and Shi Fu and Zheng Zhang and Xiaoning Wu and Xuzeng Fan and Dacheng Tao and Xiaogang Wang},
      year={2026},
      eprint={2606.16533},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2606.16533}, 
}

🙏 10. Acknowledgements

We would like to thank the contributors to Qwen-Image, Wan2.1, DiffSynth-Studio, FastWAM and HuggingFace for their open-source research contributions.

---

⭐ Star us on GitHub if you find Kairos helpful!