Downloads · 30 days
116
5% of all-time downloads
finetrainers/pika-dissolve-v0
pika-dissolve-v0 is a text-to-video model from finetrainers. Use it when you need video from a text prompt. It is set up for diffusers. The card lists the license as other.
Downloads · 30 days
116
5% of all-time downloads
All-time downloads
2.3K
Public
Parameters
5.6B
22.3 GB on disk
Likes
12
Public
Click a slice to open those files.
.safetensors22.3 GB · 100%
From the Hugging Face model README
This is a fine-tune of the THUDM/CogVideoX-5b model on the modal-labs/dissolve dataset.
Code: https://github.com/a-r-r-o-w/finetrainers
Inference code:
from diffusers import CogVideoXTransformer3DModel, DiffusionPipeline
from diffusers.utils import export_to_video
import torch
transformer = CogVideoXTransformer3DModel.from_pretrained(
"sayakpaul/pika-dissolve-v0", torch_dtype=torch.bfloat16
)
pipeline = DiffusionPipeline.from_pretrained(
"THUDM/CogVideoX-5b", transformer=transformer, torch_dtype=torch.bfloat16
).to("cuda")
prompt = """
PIKA_DISSOLVE A slender glass vase, brimming with tiny white pebbles, stands centered on a polished ebony dais. Without warning, the glass begins to dissolve from the edges inward. Wisps of translucent dust swirl upward in an elegant spiral, illuminating each pebble as they drop onto the dais. The gently drifting dust eventually settles, leaving only the scattered stones and faint traces of shimmering powder on the stage.
"""
negative_prompt = "inconsistent motion, blurry motion, worse quality, degenerate outputs, deformed outputs"
video = pipeline(
prompt=prompt,
negative_prompt=negative_prompt,
num_frames=81,
height=512,
width=768,
num_inference_steps=50
).frames[0]
export_to_video(video, "output_vase.mp4", fps=25)