One-to-All-14b

One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer

This repository contains the model and code for the paper One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer.

This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs.

• 📄 Paper
• 🌐 Project Page
• 💻 Code on GitHub

🎭 Showcase

Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.

14B Model

<table align="center"> <tr> <th style="text-align: center;">Reference</th> <th style="text-align: center;">Motion 1</th> <th style="text-align: center;">Motion 2</th> <th style="text-align: center;">Motion 3</th> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td> </tr> </table> <br>

1.3B Model

The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).

<table align="center"> <tr> <th style="text-align: center;">Reference</th> <th style="text-align: center;">Motion 1</th> <th style="text-align: center;">Motion 2</th> <th style="text-align: center;">Motion 3</th> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td> </tr> </table>

Also support longer video & out-of-domain cases

<table align="center"> <tr> <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td> <td>&nbsp;&nbsp;&nbsp;&nbsp;</td> <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td> </tr> </table> <br>

Acknowledgments

Our project is based on opensora. Some codes are brought from StableAnimator and Wan-Animate. Thanks for their awesome works.

📧 Contact

If you have any questions, please feel free to reach us at [email protected]

📝 Citation

If you find our work helpful or inspiring, please feel free to cite it.

@article{shi2025one,
  title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
  author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
  journal={arXiv preprint arXiv:2511.22940},
  year={2025}
}