lexy-vox-t2v-lora-training-wan2.2

Lexy Vox – Wan 2.2 T2V LoRA (v2)

Character-specific LoRA for Wan 2.2 14B Text-to-Video / Text-to-Image generation.

Trained with musubi-tuner on a mixed dataset of images and videos.

Quick Start (Wavespeed API)

Use the diffusers format files (root directory) with both low_noise_loras and high_noise_loras:

import requests

response = requests.post(
    "https://api.wavespeed.ai/api/v3/wavespeed-ai/wan-2.2/t2v-720p-lora",
    headers={
        "Content-Type": "application/json",
        "Authorization": "Bearer YOUR_API_KEY"
    },
    json={
        "prompt": "lexy_vox, close-up portrait, warm smile, natural daylight, sharp focus",
        "size": "1280x720",
        "duration": 5,
        "low_noise_loras": [{"path": "https://huggingface.co/dustin2050/lexy-vox-t2v-lora-training-wan2.2/resolve/main/lexy_vox_t2v_v2_diffusers.safetensors", "scale": 1.0}],
        "high_noise_loras": [{"path": "https://huggingface.co/dustin2050/lexy-vox-t2v-lora-training-wan2.2/resolve/main/lexy_vox_t2v_v2_diffusers.safetensors", "scale": 1.0}]
    }
)

Important: Wan 2.2 uses a dual-DiT architecture. You must pass the LoRA to both low_noise_loras and high_noise_loras. Using only one will produce incorrect results.

Local Inference (musubi-tuner)

Use the kohya format files (kohya/ directory) with both --lora_weight and --lora_weight_high_noise:

python wan_generate_video.py \
  --task t2v-14B \
  --prompt "lexy_vox, close-up portrait, warm smile" \
  --lora_weight kohya/lexy_vox_t2v_v2.safetensors \
  --lora_weight_high_noise kohya/lexy_vox_t2v_v2.safetensors \
  --video_size 832 480 \
  --video_length 33 \
  --seed 42

Trigger Word

Use lexy_vox in your prompts to activate the character identity.

Files

The final checkpoints (without epoch number) are from epoch 25 (best).

Format Difference

• Diffusers: Key pattern diffusion_model.blocks.0.cross_attn.k.lora_A.weight (800 keys)
• Kohya: Key pattern lora_unet_blocks_0_cross_attn_k.lora_down.weight (1200 keys incl. alpha)

Both contain identical weights, just different key naming conventions. Convert between them using musubi-tuner's convert_lora.py.

Training Details

Training Dataset

Total: 160 batches per epoch, 4000 total steps (25 epochs x 160 batches / 2 grad accum).

Related

• I2V LoRA: dustin2050/lexy-vox-i2v-lora-training-wan2.2