HunyuanDiT_Controlnet_lineart

Key to use this inapainting model, set the weight or strengh with 0.7-0.8 to get the best result!!!!

Tencent HunyuanDiT Lineart Controlnet

An amazing controlnet model which can provide you incrediable consistent and crativity to the original image!

it is trained with various resolution of images and masks to provide nice robust to the the base model. now it can create the new image with the same style of the original one, following are some example to show the result!

Thanks for MistoLine team provide provided the logic how to process the image in SDXL, I referred some code from them to build this lineart!

Capability#1 canny restore

support standard canny preprocessor

<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/Lh9VJHTFCihDL1gymWlCr.jpeg" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/VW4iVykZZKwj9ZMvZDXOF.png" alt="imageNo2" width="50%"/> </p>

Capability #2 Anyline restore

Recovery from with anyline preprocessor by mistoline

<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/4Fu9i53_wS1ZwdRuqdk4C.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/qtljaNl95vHM9oHu2N4B0.png" alt="imageNo2" width="50%"/> </p> <p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/K2PwN-NPiDiRJJqRDCAMv.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/NBJxc07VWUdoqHNXYcDtz.png" alt="imageNo2" width="50%"/> </p>

Capability #3 Black and white comic/animate image recolor!

Step1: reverse color the comic image

Step2: Use inpainting controlnet to color it with prompts!

Other Highlights!

Adapter for both animation and realistic!

<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/IU1fuhIGsLmYuQYugJZJp.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/AX1TTmd6lkgIzACJpTJnJ.png" alt="imageNo2" width="50%"/> </p>

Nice for building and indoor images!

<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/A5iR07UhX85BqppBiDwgf.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/N7XGfXfHkQQqILZydLh-9.png" alt="imageNo2" width="50%"/> </p>

Super realistic quality!

<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/Yiryq5MamXCFrhkE-niUm.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/yNke7RwVWFrSAMQh_hlqJ.png" alt="imageNo2" width="50%"/> </p>

Again NSFW ready, need FT on the base model to output stable NSFW image

in the end, enjoy the HunyuanDiT

Join my QQ group if you appreiate my job: 294060503 or contact my wechat: tangtuanzhu