Identity-as-Presence

<h2 align="center">Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation</h2> <p align="center"> <a href="https://chen-yingjie.github.io/"><strong>Yingjie Chen</strong></a> · <a href=""><strong>Shilun Lin</strong></a> · <a href=""><strong>Cai Xing</strong></a> · <a href=""><strong>Qixin Yan</strong></a> · <a href=""><strong>Wenjing Wang</strong></a> <br> <a href=""><strong>Dingming Liu</strong></a> · <a href=""><strong>Hao Liu</strong></a> · <a href=""><strong>Chen Li</strong></a> · <a href=""><strong>Jing LYU</strong></a> <br> <br> <a href="https://arxiv.org/abs/2603.17889"><img src='https://img.shields.io/badge/arXiv-2603.17889-red' alt='Paper PDF'></a> <a href='https://chen-yingjie.github.io/projects/Identity-as-Presence/index.html'><img src='https://img.shields.io/badge/Project-Page-blue' alt='Project Page'></a> <a href='https://github.com/WeChatCV/Identity-as-Presence'><img src='https://img.shields.io/badge/Github-Identity--as--Presence-orange'></a> <a href='https://huggingface.co/echoanran/Identity-as-Presence'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a> <br> <b></a>Multimedia Computing Group, Nanjing University &nbsp; | &nbsp; </a>Platform and Content Group (PCG), Tencent </b> <br> </p> </p>

This repository is the official implementation of "Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation". Identity-as-Presence is a unified and scalable framework for identity-aware joint audio-video generation, enabling high-fidelity and consistent personalization. Specifically, we introduce a data curation pipeline that automatically extracts identity-bearing information with paired annotations across audio and visual modalities, covering diverse scenarios from single-subject to multi-subject interactions. We further propose a flexible and scalable identity injection mechanism for single- and multi-subject scenarios, in which both facial appearance and vocal timbre act as identity-bearing control signals.

🔗 Citation

If you find this model useful for your research, please use the following BibTeX entry.

@inproceedings{chen2026identity,
  title={Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation},
  author={Chen, Yingjie and Lin, Shilun and Xing, Cai and Yan, Qixin and Wang, Wenjing and Liu, Dingming and Liu, Hao and Li, Chen and LYU, Jing},
  journal={arXiv preprint arXiv:TBD},
  website={https://chen-yingjie.github.io/projects/Identity-as-Presence/index.html},
  year={2026}}