nighttime-lora

Nighttime LoRA

<Gallery />

Model description

<p>This lora can turn any scene into a night scene, indoors and outdoors. Not just darker, but with flashlights, car lights, etc. Some scenes will need a stronger weight than others. So adjust as needed. </p><p>This is an experiment in a training process concept I am working on I call seed locking. Initial results looked good, but it still needs work. The basic idea is to generate training images and regularization images with a specific seed, then alter the training images with the desired effect while maintaining image consistency, and then retrain with those specific seeds to target very specific concepts you want to adjust and keeping everything else the same. It is not perfect because of the sampling methods. I hope to find a way to regularize for the sampler in the loss, hopefully soon. </p><p>But for now, enjoy the experiment.</p><p></p>

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('runwayml/stable-diffusion-v1-5', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('ostris/nighttime-lora', weight_name='nighttime_v1.safetensors')
image = pipeline('a woman super excited, holding a jar with  fireflies  ').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers