Downloads · 30 days
213K
16% of all-time downloads
ByteDance/LatentSync-1.6
LatentSync-1.6 is a machine learning model from ByteDance. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for torchgeo. The card lists the license as openrail++.
Downloads · 30 days
213K
16% of all-time downloads
All-time downloads
1.3M
Public
Repo size
9.6 GB
Likes
79
Public
Click a slice to open those files.
.pt6.8 GB · 71%
From the Hugging Face model README
Paper: https://arxiv.org/abs/2412.09262
Code: https://github.com/bytedance/LatentSync
Many people have reported that the teeth and lips generated by LatentSync 1.5 are blurry. To address this issue, we trained LatentSync 1.6 on 512 x 512 resolution videos.
Notably, we did not make any changes to the model structure or training strategy; the only modification was upgrading the training dataset to 512 x 512 videos. Therefore, the current code is compatible with both LatentSync 1.5 and 1.6. To switch between versions, you only need to load the corresponding checkpoint and modify the resolution parameter in the U-Net config file.
You can view the demo in LatentSync's official GitHub repo.