Downloads · 30 days
0
openlipsync
miguelamendez/openlipsync
openlipsync is a machine learning model from miguelamendez. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for diffusers.
This is a small repository containing all the required files to run inference for LatentSync1.5.
Access
Public
Updated Sep 26, 2025
Repo size
9.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt5.5 GB · 60%
At a glance
- Library
- diffusers
- Access
- Public
- Created
- Sep 25, 2025
- Updated
- Sep 26, 2025
- SHA
- 4f1e23ed
Model card
From the Hugging Face model README
OpenLipSync
This is a small repository containing all the required files to run inference for LatentSync1.5.
Installation
- Clone the repo
- On Debian-based systems, run
bash debian_setup.shfor both local and modal (remote inference) - For remote inference with Modal, you must first create the volume by running:
uv run modal run scripts/modal_download_extras.py
uv run modal run scripts/modal_download_models.py
Running Inference
Local Inference
Modify the inference.py file at the root of the directory (add the path of your video and file). Then run with:
uv run inference.py
Remote Inference
Modify the modal_lipsync_inference.py file at the root of the directory (add the path of your video and file). Then run with:
uv run modal run modal_lipsync_inference.py
Remote Inference with FastAPI Endpoints
Run:
uv run modal run modal_lipsync_serve.py
TODO:
- Add MuseTalk checkpoints
- Add LatentSync16 checkpoints
- Library
- diffusers
- Created
- Sep 25, 2025
- Updated
- Sep 26, 2025