Animate-X

<p align="center"> <h2 align="center">Animate-X: Universal Character Image Animation with Enhanced Motion Representation</h2> <p align="center"> <a href=""><strong>Shuai Tan</strong></a> · <a href="https://scholar.google.com/citations?user=BwdpTiQAAAAJ"><strong>Biao Gong</strong></a>^† · <a href="https://scholar.google.com/citations?user=cQbXvkcAAAAJ"><strong>Xiang Wang</strong></a> · <a href="https://scholar.google.com/citations?user=ZO3OQ-8AAAAJ"><strong>Shiwei Zhang</strong></a> <br> <a href="https://openreview.net/profile?id=~DanDan_Zheng1"><strong>Dandan Zheng</strong></a> · <a href="https://scholar.google.com.hk/citations?user=S8FmqTUAAAAJ"><strong>Ruobing Zheng</strong></a> · <a href="https://scholar.google.com/citations?user=hMDQifQAAAAJ"><strong>Kecheng Zheng</strong></a> · <a href="https://openreview.net/profile?id=~Jingdong_Chen1"><strong>Jingdong Chen</strong></a> · <a href="https://openreview.net/profile?id=~Ming_Yang2"><strong>Ming Yang</strong></a> <br> <br> <a href="https://arxiv.org/abs/2410.10306"><img src='https://img.shields.io/badge/arXiv-Animate--X-red' alt='Paper PDF'></a> <a href='https://lucaria-academy.github.io/Animate-X/'><img src='https://img.shields.io/badge/Project_Page-Animate--X-blue' alt='Project Page'></a> <a href='https://mp.weixin.qq.com/s/vDR4kPLqnCUwfPiBNKKV9A'><img src='https://badges.aleen42.com/src/wechat.svg'></a> <a href='https://github.com/antgroup/animate-x'><img src='https://img.shields.io/badge/Code-Animate--X-yellow'></a> <br> <b></a>Ant Group &nbsp; | &nbsp; </a>Tongyi Lab </b> <br> </p> </p>

This repo include the checkpoints for Animate-X:

• "checkpoints/dw-ll_ucoco_384.onnx": the checkpoint for dwpose extraction.

• "checkpoints/open_clip_pytorch_model.bin": the checkpoint for clip embedding.

• "checkpoints/animate-x_ckpt.pth": the checkpoint for X-character image animation in Animate-X (32 frames).

• "checkpoints/yolox_l.onnx": the checkpoint for dwpose extraction.

• "checkpoints/v2-1_512-ema-pruned.ckpt": the checkpoint for Stable Diffusion.

BibTeX

If this repo is useful to you, please cite our corresponding technical paper.

@article{AnimateX2025,
  title={Animate-X: Universal Character Image Animation with Enhanced Motion Representation},
  author={Tan, Shuai and Gong, Biao and Wang, Xiang and Zhang, Shiwei and Zheng, Dandan and Zheng, Ruobing and Zheng, Kecheng and Chen, Jingdong and Yang, Ming},
  journal={arXiv preprint arXiv:2410.10306},
  year={2025}
}