SwarmUI
SwarmUI copied to clipboard
Inpainting ControlNet is broken, ControlNet receives incorrect mask when inpainting
Expected Behavior
I want to have Inpaint Preprocessor to receive a cropped mask.
Actual Behavior
Swarm generates this workflow:
(preview is added by me for convenience)
As you can see, Inpaint Preprocessor receives the non-cropped mask for the inpainting. This makes it impossible to inpaint with ControlNet since the model receives incorrect mask. Note that the image received by Inpaint Preprocessor does get cropped.
Steps to Reproduce
- Load any SDXL model
- Put any image into the generate tab and click "Edit Image"
- Enable "Mask Shrink Grow"
- Enable ControlNet, set preprocessor to InpaintPreprocessor, select inpainting model
- Create a mask in the image editor
- Click "Generate"
Debug Logs
N/A. Swarm version: 0.9.7.0
Other
xinsir's controlnet models are also unusable because the controlnet_aux extension sets Inpaint Preprocessor's "black_pixel_for_xinsir_cn" to "false" by default, and SwarmUI doesn't provide a way to change this option. I opted to change the default to true within the extension node itself.