Downloads Ā· 30 days
0
MagicClothing
ShineChen1024/MagicClothing
MagicClothing is a machine learning model from ShineChen1024. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-sa-4.0.
This repository is the official implementation of Magic Clothing
Access
Public
Updated Jul 10, 2024
Repo size
45 GB
Likes
110
Public
Repo makeup
Click a slice to open those files.
.safetensors44.7 GB Ā· 99%
At a glance
- License
- cc-by-nc-sa-4.0
- Access
- Public
- Created
- Feb 20, 2024
- Updated
- Jul 10, 2024
- SHA
- 02ab703f
Model card
From the Hugging Face model README
Magic Clothing
This repository is the official implementation of Magic Clothing
Magic Clothing is a branch version of OOTDiffusion, focusing on controllable garment-driven image synthesis
<!-- Please refer to our [previous paper](https://arxiv.org/abs/2403.01779) for more details -->Magic Clothing: Controllable Garment-Driven Image Synthesis [arXiv paper]<br> Weifeng Chen*, Tao Gu*, Yuhao Xu, Chengcai Chen<br> * Equal contribution<br> Xiao-i Research
News
š„ [2024/4/19] An 1024 version trained on both VTON-HD and DressCode for early access branch is avaliable now!
š„ [2024/4/19] We support AnimateDiff now for generating GIF!
š„ [2024/4/16] Our paper is available now!
š„ [2024/3/8] We released the model weights trained on the 768 resolution. The strength of clothing and text prompts can be independently adjusted.
š¤ Hugging Face link
š„ [2024/2/28] We support IP-Adapter-FaceID with ControlNet-Openpose! A portrait and a reference pose image can be used as additional conditions.
Have fun with gradio_ipadapter_openpose.py
š„ [2024/2/23] We support IP-Adapter-FaceID now! A portrait image can be used as an additional condition.
Have fun with gradio_ipadapter_faceid.py
Ā
Installation
- Clone the repository
git clone https://github.com/ShineChen1024/MagicClothing.git
- Create a conda environment and install the required packages
conda create -n magicloth python==3.10
conda activate magicloth
pip install torch==2.0.1 torchvision==0.15.2 numpy==1.25.1 diffusers==0.25.1 opencv-python==4.9.0.80 transformers==4.31.0 gradio==4.16.0 safetensors==0.3.1 controlnet-aux==0.0.6 accelerate==0.21.0
Inference
- Python demo
512 weights
python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path]
768 weights
python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path] --enable_cloth_guidance
- Gradio demo
512 weights
python gradio_generate.py --model_path [your model checkpoints path]
768 weights
python gradio_generate.py --model_path [your model checkpoints path] --enable_cloth_guidance
Citation
@article{chen2024magic,
title={Magic Clothing: Controllable Garment-Driven Image Synthesis},
author={Chen, Weifeng and Gu, Tao and Xu, Yuhao and Chen, Chengcai},
journal={arXiv preprint arXiv:2404.09512},
year={2024}
}
TODO List
- Paper
- Gradio demo
- Inference code
- Model weights
- Training code
- License
- cc-by-nc-sa-4.0
- Created
- Feb 20, 2024
- Updated
- Jul 10, 2024