Downloads · 30 days
0
HunyuanDiT_Controlnet_inpainting
TTPlanet/HunyuanDiT_Controlnet_inpainting
HunyuanDiT_Controlnet_inpainting is a machine learning model from TTPlanet. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
The model will be released once Hunyuan DiT comfyui controlnet is fully supported.
Access
Public
Updated Aug 15, 2024
Repo size
1.5 GB
Likes
28
Public
Repo makeup
Click a slice to open those files.
.pt1.5 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jul 26, 2024
- Updated
- Aug 15, 2024
- SHA
- 86db23ce
Model card
From the Hugging Face model README
The model will be released once Hunyuan DiT comfyui controlnet is fully supported.
Tencent HunyuanDiT Inpainting Controlnet
An amazing controlnet model which can provide you incrediable consistent and crativity to the original image!
it is trained with various resolution of images and masks to provide nice robust to the the base model. now it can create the new image with the same style of the original one, following are some example to show the result! comfyui inpainting preprocessor to combine the mask and img: https://github.com/TTPlanetPig/Comfyui_TTP_CN_Preprocessor
Let's have a game!
which one is original one? select wisely
Left one is No1 and right one is No2
<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/Vm2cj0E0CtFwXzPmYn-fP.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/u_vnNOWVVdlt0Lfc1r7mJ.png" alt="imageNo2" width="50%"/> </p>I have done my own test, for the most people they will select No1 as original image, however, No2 is the original one and No1 is the image with inpainting control with Hunyuan DiT model.
Other capablity!
Recovery from 70% mask area but still keep consistency!
Example: Maksed image: <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/PtXvG-I2cGQemtpehgVLP.png" alt="描述文本" width="60%"/> a muscle man with blue eyes： <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/IbIp_pIbiH_XgfDH-Xyq1.png" alt="描述文本" width="60%"/> a man in batman suit with eye cover: <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/6qxpY74wVJ5hyWnAomU8m.png" alt="描述文本" width="60%"/>
Multiple area inpainting with different prompts，and correctly understand the depth of field!
Masked 3 individual area: <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/1U3dfNIfw12kfAfHe1DnF.png" alt="描述文本" width="60%"/> An Asian man with long sleeve T-shirt, in the background there is a yellow dog： <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/KkEpb6CwORN-PerMXkYfo.png" alt="描述文本" width="60%"/>
Multiple area inpainting with high consistency!
<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/V0aIOqEdXS_ynVtUM2Yin.png" alt="imageNo1" width="300px"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/LeOCVHabycvH5J-0EGJ5E.png" alt="imageNo1" width="300px"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/r8p2u_il1pmMwezPp9zJq.png" alt="imageNo2" width="300px"/> </p>Amazing outpainting!
<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/HnuDDorI1P2xGsmdpME5M.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/uw1A4kttYeLDSooo7jFNw.png" alt="imageNo2" width="50%"/> </p>high quality inpainting adapter to the original photo style or light!
Masked image: <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/6y_0pOYP2DwseD0mKrpcJ.png" alt="描述文本" width="60%"/>
<p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/wR3m1V2zEwkDewboFQ3W_.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/sYAPzY_WUH1cc4O2SQ1ga.png" alt="imageNo2" width="50%"/> </p> <p style="display: flex; justify-content: space-between;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/xV66yMlc9BqPqLC8F-kO9.png" alt="imageNo1" width="50%"/> <img src="https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/f3_SEagz6mx2tE3lxhaw9.png" alt="imageNo2" width="50%"/> </p>in the end, enjoy the HunyuanDiT
Join my QQ group if you appreiate my job: 294060503 or contact my wechat: tangtuanzhu
- License
- mit
- Created
- Jul 26, 2024
- Updated
- Aug 15, 2024