Flux Xlabs ControlNet does not work in Flux UNET

[JorgeR81]

Expected Behavior

Use Xlabs ControlNet, with Flux UNET, the same way I use it with Flux checkpoint.

Actual Behavior

I have no errors, but GPU usage gets very high.

It just gets stuck in the KSampler stage, before even generating the first step, so I have to cancel the queue.

Steps to Reproduce

Just set up a regular ControlNet workflow, using the Unet loader, with Flux.

Existing Solutions

Now, it requires custom nodes from XLabs. https://github.com/XLabs-AI/x-flux-comfyui

Other

It seems Flux UNET never worked, even during the Xlabs ControlNet Pull request stage. But there was a specific error back then:

https://github.com/comfyanonymous/ComfyUI/pull/4260#issuecomment-2277509058