serene-sdxl-lora

Serene — SDXL LoRA

A custom SDXL LoRA that renders a consistent brand-ambassador likeness named Serene. Trained on a small curated dataset for use as a recurring face across social-media campaigns.

<table> <tr> <td><img src="./preview/serene-1.png" alt="Serene 1" width="260"/></td> <td><img src="./preview/serene-2.png" alt="Serene 2" width="260"/></td> <td><img src="./preview/serene-3.png" alt="Serene 3" width="260"/></td> </tr> <tr> <td><img src="./preview/serene-4.png" alt="Serene 4" width="260"/></td> <td><img src="./preview/serene-5.png" alt="Serene 5" width="260"/></td> <td><img src="./preview/serene-6.png" alt="Serene 6" width="260"/></td> </tr> </table>

Trigger token

ohwx_serene

Include the trigger anywhere in your prompt. Best results when the trigger appears at the start of the prompt and the prompt clearly describes a single woman as the subject of the frame.

Quick example

ohwx_serene, a portrait photograph of a young woman, soft natural light,
neutral background, looking at the camera, magazine-cover quality,
professional studio lighting on her face.

Use with 🤗 Diffusers

from diffusers import StableDiffusionXLPipeline
import torch

pipe = StableDiffusionXLPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    torch_dtype=torch.float16,
).to("cuda")

pipe.load_lora_weights(
    "ajaynegi0079/serene-sdxl-lora",
    weight_name="pytorch_lora_weights.safetensors",
)

image = pipe(
    "ohwx_serene, portrait, soft studio light, magazine cover quality",
    num_inference_steps=30,
    guidance_scale=7.0,
).images[0]
image.save("serene.png")

Use on Replicate

The repo also ships a Replicate-compatible bundle (serene_lora_v2.tar) for use with cog-style SDXL+LoRA predictors such as fofr/sdxl-multi-controlnet-lora:

{
  "prompt": "ohwx_serene, ...",
  "lora_weights": "https://huggingface.co/ajaynegi0079/serene-sdxl-lora/resolve/main/serene_lora_v2.tar",
  "lora_scale": 0.95,
  "num_inference_steps": 30,
  "scheduler": "K_EULER"
}

Recommended settings

Training

Files in this repo

• pytorch_lora_weights.safetensors — raw diffusers/PEFT LoRA, for direct pipe.load_lora_weights() use
• serene_lora_v2.tar — Replicate cog-sdxl bundle (lora.safetensors with cog-style key names + empty embeddings.pti stub)
• preview/serene-1.png … preview/serene-6.png — sample images from the training dataset

License

CC BY-NC 4.0 — non-commercial use only. For commercial / brand-ambassador licensing, contact the repo owner.