ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

The [ SetUnionControlNetType ] options don't mach Flux ControlNet Union modes

Open JorgeR81 opened this issue 1 year ago • 5 comments

Expected Behavior

This model supports 7 control modes, including canny (0), tile (1), depth (2), blur (3), pose (4), gray (5), low quality (6).

https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro

Actual Behavior

un

Other

This was implemented first in a custom node ( now deprecated ). https://github.com/EeroHeikkinen/ComfyUI-eesahesNodes/issues

The node creator made a post with some indications: https://www.reddit.com/r/StableDiffusion/comments/1f69wbs/latest_version_of_comfyui_now_includes_native/

It seems the order of the options is correct, but they are not properly labeled. 

  • canny - "openpose"
  • tile - "depth"
  • depth - "hed/pidi/scribble/ted"
  • blur - "canny/lineart/anime_lineart/mlsd"
  • pose - "normal"
  • grayscale - "segment"
  • low quality - "tile"

JorgeR81 avatar Sep 07 '24 10:09 JorgeR81

@comfyanonymous You forgot the noise option.

Vigilence avatar Sep 11 '24 20:09 Vigilence

@comfyanonymous You forgot the noise option.

That may be the "low_quality" option, because they don't have a picture for that.

They probably changed their mind on how to name this option, hence the incorrect naming, in that section.

But the "low_quality" name, just by itself, can also be confusing for the user.

I think it could be better to have something like "low_quality / noise / grain" in the dropdown list, for Comfy UI.

JorgeR81 avatar Sep 11 '24 20:09 JorgeR81

I asked on their huggingface page for clarification just to be sure.

Vigilence avatar Sep 11 '24 22:09 Vigilence

Thanks to eesahe / https://www.reddit.com/user/eesahe/

"For a readymade complete workflow (if a bit messy), you can download my updated workflow from here: https://civitai.com/models/709352"

it works!

simmmis avatar Sep 15 '24 21:09 simmmis

A new SetShakkerLabsUnionControlNetType node was added to the ComfyUI-KJNodes, a few days ago:

https://github.com/kijai/ComfyUI-KJNodes/commit/13242fc3bfdf23ef8706cdff5c57dffa689735b1

JorgeR81 avatar Sep 26 '24 23:09 JorgeR81