comfyanonymous
When using the flux model of controlnet, this problem occurs: Error occurred when executing ControlNetLoader: MMDiT.__init__() got an unexpected keyword argument 'image_model'
Your question
I encountered this problem when using the flux model of controlnet. My comfyui is already the latest version. I don't know why. Has anyone encountered the same situation as me? How to solve it?
Logs
No response
Other
No response
I think you're using a model from InstantX and that they aren't supported yet. I might be mistaken, but I think only the Flux Controlnets by XLabs-AI are supported
I think you're using a model from InstantX and that they aren't supported yet. I might be mistaken, but I think only the Flux Controlnets by XLabs-AI are supported
Yeah the InstantX controlnet is for diffusers. It would need to be converted to work with comfyui and I don't know if there's some easy runtime on the fly method of converting it. Looking at their blocks(click the little two layers looking icon next to the file name in the huggingface repo), they look very different from each other, so probably not.
Thank you two brothers above, this is indeed the reason. I just need to switch to XLabs-AI's controlnet. I was using InstantX's controlnet before.
Problem is Xlabs controlnet sucks at inpaint, and InstantX doesn't. The Union ControlNet works great but is quite heavy. Would be nice to be able to use the Canny (lighter).
replace the controlnet load for "InstantX Flux Union ControlNet Loader". I had the same error and after I replaced the node it worked. https://www.youtube.com/watch?v=DVZikxmIbo0
how did you update? from manager?
If you are using ComfyUI Windows Portable,
- run
ComfyUI_windows_portable\update\update_comfyui.bat - Restart ComfyUI > Manager > Update all
