ControlNet Usage

[jfischoff]

The documentation says

Similarly, if you want to use ControlNet or SDEedit, create a yaml config as in ``config/config_controlnet.yaml

Want should go in the config/config_controlnet.yaml. I tried to figure it out from looking at the code, but only saw the controlnet being used during preprocessing.

[Natotela]

I'm guessing this would be added in the future

[EladWarshawsky]

The documentation says

Similarly, if you want to use ControlNet or SDEedit, create a yaml config as in ``config/config_controlnet.yaml

Want should go in the config/config_controlnet.yaml. I tried to figure it out from looking at the code, but only saw the controlnet being used during preprocessing.

Pretty sure that the controlnet is used in preprocess.py, when inverting the images into the latent space so as to directly preserve structural constraints. You can look into how parameters might be added there through a config. I'm using this repo for a project of mine and will see about adding a pull request when I'm finished. Two years too late lol