General_motionLoRA_32fr_sd15_ad2_v1

Training

This LoRA was trained on RunPod cloud GPUs.

Model Description

This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's AnimateDiff Motion Director ComfyUI nodes. These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's AnimateDiff-Evolved nodes, however they may be compatible with other AnimateDiff implementations.

File summary

How to use

• copy the motion lora files into your "ComfyUI\models\animatediff_motion_lora" folder
• Use the "Load Animatediff LoRA" node
• set the context_length parameter to 32 and context_overlap to 8 (it might work with other values but this is how I tested it)

Settings and recommendations

• Use it with strength: 0.8

• This motion LoRA is finetuned on a v2 motion model. It works also with AnimateLCM but don't work with v3 models

• It works with SD 1.5 checkpoints

• Animatediff v3 adapter LoRA is recommended regardless it is a v2 model.

• If you want more motion try increasing the scale multival or lower the strength of the v3 adapter LoRA

• Try playing with the strength of

  • motion LoRA
  • scale multival
  • v3_adapter lora

  like increasing the scale multival and lowering the lora strength.

• I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.

Examples

<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00112.mp4" title="zoom in 32 frames"></video>

<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00113.mp4" title="zoom in 32 frames"></video>

<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00115.mp4" title="zoom in 32 frames"></video>

<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00116.mp4" title="zoom in 32 frames"></video>

Support

Producing and sharing this kind of open-source work requires renting cloud GPUs, which gets expensive quickly. If you find it useful and would like me to keep contributing, your support is very much appreciated: