Downloads · 30 days
47
38% of all-time downloads
puterijessica/LatentSync-1.6
LatentSync-1.6 is a machine learning model from puterijessica. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for torchgeo. The card lists the license as openrail++.
Downloads · 30 days
47
38% of all-time downloads
All-time downloads
125
Public
Repo size
9.6 GB
Likes
0
Public
Click a slice to open those files.
.pt6.8 GB · 71%
From the Hugging Face model README
Paper: https://arxiv.org/abs/2412.09262
Code: https://github.com/bytedance/LatentSync
Many people have reported that the teeth and lips generated by LatentSync 1.5 are blurry. To address this issue, we trained LatentSync 1.6 on 512 x 512 resolution videos.
Notably, we did not make any changes to the model structure or training strategy; the only modification was upgrading the training dataset to 512 x 512 videos. Therefore, the current code is compatible with both LatentSync 1.5 and 1.6. To switch between versions, you only need to load the corresponding checkpoint and modify the resolution parameter in the U-Net config file.
You can view the demo in LatentSync's official GitHub repo.