mh3-r2va-claymation-transformation

MH3 - Claymation Transformation V2 - R2VA

<Gallery />

Model description

This Minimax H3 Reference2Video LoRA aims to replicate the surreal, handcrafted look of plasticine/claymation animations, where objects morph into others with fluidity. Heavily inspired by the classic cartoon "Last Year's Snow was Falling" (LYS). (although the likeliness is obviously not 100% because of MH3's training rigidness)

Trained for 159 epochs (> 14 hours) using a musubi-tuner fork by AkaneTendo. Special thanks for the implementation of the stop-flag file as it allowed me to save the model at the minimum loss of a very unstable train. Training techniques: ostris de-distill adapter, CFG loss, base preservation loss, spatial jitter.

Example prompt:

LYS-style transformation video. <Subject 1> realistic cup of coffee is shown on a table. Suddenly, the realistic cup of coffee plasticine-transforms into a realistic parrot.

The two necessary trigger words are: "LYS-style", "plasticine-transforms"/"plasticine-melts".

This model is trained in reference2video-audio_omni mode and is very versatile!

Workflow json is among the files.

Trigger words

You should use LYS-style to trigger the video generation and plasticine-transforms/plasticine-melts to describe the actions.

Download model

Download them in the Files & versions tab.