image2

Image2

<Gallery />

About this LoRA

This is a LoRA for the FLUX.1-dev text-to-image model. It can be used with diffusers or ComfyUI.

It was trained on Replicate using AI toolkit: https://replicate.com/ostris/flux-dev-lora-trainer/train

Trigger words

You should use TOK to trigger the image generation.

Run this LoRA with an API using Replicate

import replicate

input = {
    "prompt": "TOK",
    "lora_weights": "https://huggingface.co/rodolfornn/image2/resolve/main/lora.safetensors"
}

output = replicate.run(
    "black-forest-labs/flux-dev-lora",
    input=input
)
for index, item in enumerate(output):
    with open(f"output_{index}.webp", "wb") as file:
        file.write(item.read())

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('rodolfornn/image2', weight_name='lora.safetensors')
image = pipeline('TOK').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Training details

• Steps: 1000
• Learning rate: 0.0004
• LoRA rank: 16

Contribute your own examples

You can use the community tab to add images that show off what you’ve made with this LoRA.