ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

feat: add support for HunYuanDit ControlNet

Open CrazyBoyM opened this issue 1 year ago • 4 comments

this pr add support for HunYuanDit ControlNet.

Test Example:

image image image image

Here is the official exmaple:

image

You can download controlnet model weight files here:

https://huggingface.co/Tencent-Hunyuan/HYDiT-ControlNet-v1.2/tree/main image

Here is the workflow file:

hunyuan-controlnet-workflow.json

CrazyBoyM avatar Aug 06 '24 17:08 CrazyBoyM

full workflow: image

CrazyBoyM avatar Aug 06 '24 17:08 CrazyBoyM

Base model:
https://huggingface.co/comfyanonymous/hunyuan_dit_comfyui/blob/main/hunyuan_dit_1.2.safetensors

CrazyBoyM avatar Aug 06 '24 17:08 CrazyBoyM

@comfyanonymous could you review this PR?

CrazyBoyM avatar Aug 06 '24 18:08 CrazyBoyM

condition image for test: canny asset_input_pose asset_input_depth

CrazyBoyM avatar Aug 06 '24 19:08 CrazyBoyM

I ended up changing this a bit, the node to use this controlnet is now the: "ControlNetApply SD3 and HunyuanDiT" node.

https://github.com/comfyanonymous/ComfyUI/commit/a475ec2300abb4eab845510ad0da596114174274

comfyanonymous avatar Aug 09 '24 07:08 comfyanonymous