QIE-2511-MP-AnyLight

<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/638aeb590f10aa3064f42a80/BH89b7mpwhBu9g3OJWh8v.png" width="600"/> <p> <p align="center"> ☕️ <a href="https://ko-fi.com/lilllithhhhh">Ko-fi (support me)</a> <img src="https://cdn-uploads.huggingface.co/production/uploads/638aeb590f10aa3064f42a80/v3BXVKShCUBe4S4_XJvVg.png" width="1600"/>

Introduction

Lighting is the hardest thing about AI image generation by far. Even if you specify the lighting direction with keywords, the level of control we have for lighting is primitive to say the least. It is very hard to get the desired lighting that you are actually envisioning, not just generic lighting setups like from the left, right, etc, but actual complex lighting setups that are hard to specify in just words.

Professionals and people who are serious with getting the right results require it, because currently lighting is for all intents and purposes completely random. You cannot specify the distance the AI generates the light (eg. 40ft away), nor the specific X,Y,Z angle of the light. There have been other attempts to light up a scene, such as Lighting Remap Alpha0.2, which help position lights in various positions. This does help, however, it still falls to the pitfalls mentioned previously since it's based on a 2d canvas. Wouldn't it be better to have some sort of semi real-time lighting setup where you can roughly make sure the character is lit up the way that you want it while not being bound to two-dimensions? Well, this is what this LoRA attempts to do.

How is this possible? Well, with a mix of a couple LoRAs (Material Preview style), Trellis2 model generation (or Hunyuan 2.1/3), and Blender, we can have more precise control over the lighting in the scene.

NOTE: This model is trained through the use Material Preview style renders, meaning that the use of other images in other styles is unsupported currently. Also, this LoRA is geared towards pinup-like compositions.

How do you use it?

In order to use it, you must have:

1). An image preprocessed with my Material Preview style LoRA. (Image 1)

and

2). A Blender render (Cycles or Eeeve, doesn't matter) of a Trellis2 or Hunyuan 3D model of the character in the same pose. Light up your scene the way you fancy it in the Blender viewport. (Image 2)

Once you have those two images, put them into Qwen Image Edit 2511 and only use the AnyLight LoRA with the following prompt:

Apply the lighting from image 2 to image 1.

Use at strength 1. While you can use this with the Lightx2v 4-Step Lighting LoRA, it is recommended to use the 8-step Lightning LoRA for better results. Also, bumping up the resolution to 1080p additionally improves the results, so use that for optimal performance.

NOTE: Blender renders of the same scene with Trellis 2 models don't have to be exact, i.e. they do not have to match up perfectly (angle, spacing, etc of the character). However, the Blender camera should generally reside in the same place as the input image. Getting as close to the exact angle in the input image via the Blender camera gives better results.

Showcase

Here I showcase a couple cool things I made with this LoRA:

You can do traditional lighting as you would in Blender:

Or you could even make an animation out of it:

<img src="https://cdn-uploads.huggingface.co/production/uploads/638aeb590f10aa3064f42a80/Wcm2ofnZ9hFasfM08Hgmj.gif" width="400"/>

This is the power of AnyLight!