HiDream-I1-Full-ink-drawing-lora

<!-- This model card has been generated automatically according to the information the training script had access to. You should probably proofread and complete it, then remove this comment. -->

HiDream Image DreamBooth LoRA - KristjanRRR/HiDream-I1-Full-ink-drawing-lora

<Gallery />

Model description

These are KristjanRRR/HiDream-I1-Full-ink-drawing-lora DreamBooth LoRA weights for HiDream-ai/HiDream-I1-Full.

The weights were trained using DreamBooth with the HiDream Image diffusers trainer.

Trigger words

You should use hand-drawn sketch style--caption_column=prompt to trigger the image generation.

Download model

Download the *.safetensors LoRA in the Files & versions tab.

Use it with the 🧨 diffusers library

    >>> import torch
    >>> from transformers import PreTrainedTokenizerFast, LlamaForCausalLM
    >>> from diffusers import HiDreamImagePipeline

    >>> tokenizer_4 = PreTrainedTokenizerFast.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")
    >>> text_encoder_4 = LlamaForCausalLM.from_pretrained(
    ...     "meta-llama/Meta-Llama-3.1-8B-Instruct",
    ...     output_hidden_states=True,
    ...     output_attentions=True,
    ...     torch_dtype=torch.bfloat16,
    ... )

    >>> pipe = HiDreamImagePipeline.from_pretrained(
    ...     "HiDream-ai/HiDream-I1-Full",
    ...     tokenizer_4=tokenizer_4,
    ...     text_encoder_4=text_encoder_4,
    ...     torch_dtype=torch.bfloat16,
    ... )
    >>> pipe.enable_model_cpu_offload()
    >>> pipe.load_lora_weights(f"KristjanRRR/HiDream-I1-Full-ink-drawing-lora")
    >>> image = pipe(f"hand-drawn sketch style--caption_column=prompt").images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Intended uses & limitations

How to use

# TODO: add an example code snippet for running this diffusion pipeline

Limitations and bias

[TODO: provide examples of latent issues and potential remediations]

Training details

[TODO: describe the data used to train the model]