ArcaneMochi

Fine-Tuning Mochi-Sota Text-to-Video: Jinx Lora Test

This project demonstrates the fine-tuning of the Mochi-Sota Text-to-Video model using a LoRA (Low-Rank Adaptation) approach, focusing on the character Jinx from the League of Legends universe. The goal was to adapt the model to generate dynamic, character-specific video sequences with consistent visual and motion styles.

Training Details

• Model Base: Mochi-Sota Text-to-Video
• Fine-Tuning Dataset: 17 short video clips of Jinx
• Training Settings :: 61 frames
• Training Hardware: H100 GPU
• Training Duration: 5 hours

This fine-tuning process leverages LoRA to efficiently adapt the model while preserving the core capabilities of the base model.

---

Results

Below is an example of the generated video output:

** Sample (from training only)**

Jinx sprints through a dimly lit alley, her vibrant blue hair trailing behind her. She clutches a small, bulging sack tightly against her chest. Dressed in a dark crop top and boots, she moves with chaotic energy, her boots thudding loudly on the pavement. Her mischievous grin flashes briefly as she glances back, her pace never faltering.

<video controls> <source src="https://huggingface.co/Snowad/ArcaneMochi/resolve/main/v1/samples/0_3200.mp4" type="video/mp4"> Your browser does not support the video tag. </video>

Jinx, with her striking blue hair, stands by a cracked window in a dimly lit room. The light from outside casts a soft glow on her pale skin. She wears a dark, sleeveless top and tight pants. Her arms are crossed, and she gazes out into the night, a subtle smirk on her face as she watches the city below.

<video controls> <source src="https://huggingface.co/Snowad/ArcaneMochi/resolve/main/v1/samples/1_3200.mp4" type="video/mp4"> Your browser does not support the video tag. </video>

In a derelict warehouse, Jinx crouches low to the ground, carefully placing a series of traps and wires across the floor. Her signature blue hair shines under the dim, flickering light. Wearing a loose, battle-worn top and boots, she secures a tripwire and straightens up, admiring her handiwork. She glances around the room, a wicked smile spreading across her face as she waits for her prey.

<video controls> <source src="https://huggingface.co/Snowad/ArcaneMochi/resolve/main/v1/samples/2_3200.mp4" type="video/mp4"> Your browser does not support the video tag. </video>

Jinx sprints down an urban street, her blue braids whipping behind her. She wears a tight, dark outfit with armored patches, her arms pumping as she runs. Neon lights blur past as she evades pursuers. Her face is set in determination, and she occasionally glances back over her shoulder, her playful smirk never fading as she effortlessly outpaces her enemies.

<video controls> <source src="https://huggingface.co/Snowad/ArcaneMochi/resolve/main/v1/samples/3_3200.mp4" type="video/mp4"> Your browser does not support the video tag. </video>

In a dimly lit, underground hideout, Jinx eagerly arranges an array of explosives on a wooden table. Her electric blue hair frames her wild expression as she adjusts a fuse, testing it with her fingers. She’s dressed in a patched-up vest, with a variety of gadgets hanging from her belt. With a chuckle, she lights a fuse, watching it sizzle before quickly running away, an explosive grin on her face.

<video controls> <source src="https://huggingface.co/Snowad/ArcaneMochi/resolve/main/v1/samples/4_3200.mp4" type="video/mp4"> Your browser does not support the video tag. </video> ---