Lumina-Video-f24R960

Lumina-Video

Official repository for Lumina-Video, a preliminary tryout of the Lumina series for Video Generation

Paper: Lumina-Video: Efficient and Flexible Video Generation with Multi-scale Next-DiT

Github link: Github

<h2 id="custom-gallery"> 📽️ Gallery</h2>

Text to Video results

<table border="0" style="width: 100%; text-align: center; margin-top: 1px;"> <tr> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/1.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/2.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/3.mp4" width="100%" controls autoplay loop muted></video></td> </tr> <tr> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/4.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/5.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/6.mp4" width="100%" controls autoplay loop muted></video></td> </tr> <tr> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/7.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/8.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/9.mp4" width="100%" controls autoplay loop muted></video></td> </tr> <tr> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/10.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/11.mp4" width="100%" controls autoplay loop muted></video></td> <td><video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V-examples/12.mp4" width="100%" controls autoplay loop muted></video></td> </tr> </table>

Text to Video+Audio results

<table border="0" style="width: 100%; text-align: left; margin-top: 15px; border-collapse: collapse;"> <tr> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/1.mp4" width="100%" controls autoplay loop muted></video> </td> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/2.mp4" width="100%" controls autoplay loop muted></video> </td> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/3.mp4" width="100%" controls autoplay loop muted></video> </td> </tr> <tr> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/4.mp4" width="100%" controls autoplay loop muted></video> </td> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/5.mp4" width="100%" controls autoplay loop muted></video> </td> <td> <video src="https://huggingface.co/spaces/agua123/demo_video/resolve/main/T2V%2BA-examples/6.mp4" width="100%" controls autoplay loop muted></video> </td> </tr> </table>