zgimszhd61/comfyui_magicclothing

unofficial implementation of Comfyui magic clothing

Updates:

• ✅ [2024/04/17] only cloth image with prompt generation
• ✅ [2024/04/18] IPAdapter FaceID with human face detection and synthesize with cloth image generation
• ✅ [2024/04/18] IPAdapter FaceID with controlnet openpose and synthesize with cloth image generation

You can contact with me thr twitter: FrankChieng or weixin: GalaticKing

the main workflow

IPAdapater FaceID workflow

IPAdapater FaceID chained with controlnet openpose workflow

you should run under custom_nodes directory of ComfyUI

git clone https://github.com/frankchieng/ComfyUI_MagicClothing.git

then run

pip install -r requirements.txt

download the models of cloth_segm.pth and magic_clothing_768_vitonhd_joint.safetensors from 🤗Huggingface and place them at the checkpoints directory

download the IPAdapter FaceID models from IP-Adapter-FaceID and place them under the checkpoints/ipadapter_faceid directory

./checkpoints/
|-- ipadapter_faceid
|   |-- ip-adapter-faceid-plus_sd15.bin
|   |-- ip-adapter-faceid-plus_sd15_lora.safetensors
|   |-- ip-adapter-faceid-plusv2_sd15.bin
|   |-- ip-adapter-faceid-plusv2_sd15_lora.safetensors
|   |-- ip-adapter-faceid_sd15.bin
|   |-- ip-adapter-faceid_sd15_lora.safetensors
|-- cloth_segm.pth
|-- magic_clothing_768_vitonhd_joint.safetensors

tips:If you wanna to run the controlnet openpose part,you have to install the comfyui_controlnet_aux custome code as well as download the body_pose_model.pth, facenet.pth and hand_pose_model.pth at openpose models and place them in custom_nodes/comfyui_controlnet_aux/ckpts/lllyasviel/Annotators