stable-diffusion-webui-forge
stable-diffusion-webui-forge copied to clipboard
Published
20 hours ago •
lllyasviel
lllyasviel
[Bug]: controlnet -photomaker didn't work （attached screenshot）
Checklist
- [X] The issue exists after disabling all extensions
- [ ] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet
What happened?
controlnet -photomaker didn't work
Steps to reproduce the problem
- Put the photomaker model into the model file of controlnet
- Upload multiple pictures to photomaker
- Check the keywords required for photomaker to start
What should have happened?
Generate a graphic with the faces of the people I uploaded
What browsers do you use to access the UI ?
Google Chrome
Sysinfo
Console logs
2024-02-07 00:30:30,068 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched.
To load target model BaseModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 1.02 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 13.78it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 15.72it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.34it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 15.72it/s]
2024-02-07 00:32:28,303 - ControlNet - INFO - ControlNet Input Mode: InputMode.MERGE
2024-02-07 00:32:28,304 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\bf84b36caa276a7e5b5926d32843b95aca4d5469\1570732594_instagram-jelodi-jung-68.jpg
2024-02-07 00:32:28,348 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\a0f23073960158943590e0b4d1071243311af046\9b69603b5c64b45c9d16d7fc0ff6e75e--elodie-yung-human-body.jpg_http___avatars.mds.yandex.jpg
2024-02-07 00:32:28,360 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\f8aa0e1153a28013262618a7163ec5566778559c\1_16a083549e9.1547137_3644485459_16a083549e9_large.jpg
2024-02-07 00:32:28,374 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\9a53097bb068ae6aefb15890488f1e02aa2cedeb\1570732590_instagram-jelodi-jung-19.jpg
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:29,241 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: H:\webui_forge_cu121_torch21\webui\models\ControlNet\photomaker-v1.bin
To load target model SD1ClipModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 0.39 seconds
2024-02-07 00:32:29,685 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched.
To load target model BaseModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 1.09 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.91it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 14.34it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.01it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20
Additional information
No response
The batch upload is for batch processing. It is not equivalent to previous Multi-Inputs. Multi-Inputs feature is removed. See https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/40 .
You need to turn on multiple units each with an input to achieve the same result as previous Multi-Inputs. Please file an feature request and we will see if it is necessary to add that feature back.
photomaker has never worked, I've tried it, either with a single image or multiple controlnets.
And the vertical alignment of controlnet is also rather inconvenient, is it because my UI preset is not selected correctly?
FWIW I am unable to get PhotoMaker to generate an image using the image provided in the CN Single Image console either.
Could be user error? But I'm pretty sure I have the proper model and there are no errors in the console. The generated image just isn't altered by the model.
Console clip shows no errors
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 5.26it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 4.92it/s] 2024-02-06 21:15:29,613 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 5.29it/s] 2024-02-06 21:15:29,617 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:15:29,618 - ControlNet - INFO - preprocessor resolution = 0.5 Warning torch.load doesn't support weights_only on this pytorch version, loading unsafely. 2024-02-06 21:15:32,094 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:15:32,148 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 3 Moving model(s) has taken 1.64 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:03<00:00, 7.48it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.46it/s] 2024-02-06 21:17:31,613 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.62it/s] 2024-02-06 21:17:31,617 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:17:31,617 - ControlNet - INFO - preprocessor resolution = 0.5 2024-02-06 21:17:31,738 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:17:31,791 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 2 Moving model(s) has taken 2.53 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:03<00:00, 7.42it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.05it/s] 2024-02-06 21:23:23,992 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.63it/s] 2024-02-06 21:23:23,996 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:23:23,996 - ControlNet - INFO - preprocessor resolution = 0.5 2024-02-06 21:23:24,118 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:23:24,174 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 2 Moving model(s) has taken 2.55 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.23it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.00it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.49it/s]
System Info:
Details
{
"Platform": "Windows-10-10.0.19045-SP0",
"Python": "3.10.6",
"Version": "f0.0.10-latest-58-ge6263135",
"Commit": "e62631350a408edf3b1f0a9dd45a43f9f0e95ead",
"Script path": "D:\\stable-diffusion-webui-forge",
"Data path": "D:\\stable-diffusion-webui-forge",
"Extensions dir": "D:\\stable-diffusion-webui-forge\\extensions",
"Checksum": "f1b5e4261ccd6eed11591f91ee11455510852ccc6649d03c744d021fac250d93",
"Commandline": [
"launch.py",
"--ckpt-dir",
"e:\\stable Diffusion Checkpoints"
],
"Torch env info": {
"torch_version": "2.1.2+cu121",
"is_debug_build": "False",
"cuda_compiled_version": "12.1",
"gcc_version": null,
"clang_version": null,
"cmake_version": null,
"os": "Microsoft Windows 10 Pro",
"libc_version": "N/A",
"python_version": "3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] (64-bit runtime)",
"python_platform": "Windows-10-10.0.19045-SP0",
"is_cuda_available": "True",
"cuda_runtime_version": "12.1.66\r",
"cuda_module_loading": "LAZY",
"nvidia_driver_version": "551.23",
"nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4090",
"cudnn_version": null,
"pip_version": "pip3",
"pip_packages": [
"numpy==1.26.2",
"open-clip-torch==2.20.0",
"pytorch-lightning==1.9.4",
"torch==2.1.2+cu121",
"torchdiffeq==0.2.3",
"torchmetrics==1.3.0.post0",
"torchsde==0.2.6",
"torchvision==0.16.2+cu121"
],
"conda_packages": null,
"hip_compiled_version": "N/A",
"hip_runtime_version": "N/A",
"miopen_runtime_version": "N/A",
"caching_allocator_config": "",
"is_xnnpack_available": "True",
"cpu_info": [
"Architecture=9",
"CurrentClockSpeed=3200",
"DeviceID=CPU0",
"Family=207",
"L2CacheSize=16384",
"L2CacheSpeed=",
"Manufacturer=GenuineIntel",
"MaxClockSpeed=3200",
"Name=Intel(R) Core(TM) i9-14900K",
"ProcessorType=3",
"Revision="
]
},
"Exceptions": [
{
"exception": "'dict' object has no attribute 'shape'",
"traceback": [
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f",
"res = list(func(*args, **kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f",
"res = func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img",
"processed = processing.process_images(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images",
"res = process_images_inner(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner",
"samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample",
"samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling",
"return func()"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, <lambda>",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m",
"denoised = model(x, sigmas[i] * s_in, **extra_args)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl",
"return self._call_impl(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl",
"return forward_call(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward",
"denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params,"
],
[
"D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample",
"denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function",
"cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch",
"c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control",
"self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale",
"old_width = samples.shape[3]"
]
]
},
{
"exception": "'dict' object has no attribute 'shape'",
"traceback": [
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f",
"res = list(func(*args, **kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f",
"res = func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img",
"processed = processing.process_images(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images",
"res = process_images_inner(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner",
"samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample",
"samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling",
"return func()"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, <lambda>",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m",
"denoised = model(x, sigmas[i] * s_in, **extra_args)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl",
"return self._call_impl(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl",
"return forward_call(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward",
"denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params,"
],
[
"D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample",
"denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function",
"cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch",
"c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control",
"self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale",
"old_width = samples.shape[3]"
]
]
},
{
"exception": "'dict' object has no attribute 'shape'",
"traceback": [
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f",
"res = list(func(*args, **kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f",
"res = func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img",
"processed = processing.process_images(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images",
"res = process_images_inner(p)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner",
"samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample",
"samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling",
"return func()"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, <lambda>",
"samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m",
"denoised = model(x, sigmas[i] * s_in, **extra_args)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl",
"return self._call_impl(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl",
"return forward_call(*args, **kwargs)"
],
[
"D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward",
"denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params,"
],
[
"D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample",
"denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function",
"cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch",
"c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control",
"self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)"
],
[
"D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale",
"old_width = samples.shape[3]"
]
]
}
],
"CPU": {
"model": "Intel64 Family 6 Model 183 Stepping 1, GenuineIntel",
"count logical": 32,
"count physical": 24
},
"RAM": {
"total": "64GB",
"used": "15GB",
"free": "49GB"
},
"Extensions": [
{
"name": "a2-adetailer",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\a2-adetailer",
"version": "8f01dfda",
"branch": "main",
"remote": "https://github.com/Bing-su/adetailer.git"
},
{
"name": "b1111-sd-webui-tagcomplete",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\b1111-sd-webui-tagcomplete",
"version": "829a4a7b",
"branch": "main",
"remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git"
},
{
"name": "frame2frame",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\frame2frame",
"version": "",
"branch": null,
"remote": null
},
{
"name": "sd-Img2img-batch-interrogator",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-Img2img-batch-interrogator",
"version": "7f4e4eb0",
"branch": "main",
"remote": "https://github.com/Alvi-alvarez/sd-Img2img-batch-interrogator.git"
},
{
"name": "sd-canvas-editor",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-canvas-editor",
"version": "e4c9e15f",
"branch": "master",
"remote": "https://github.com/jtydhr88/sd-canvas-editor.git"
},
{
"name": "sd-dynamic-prompts",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-dynamic-prompts",
"version": "284d3ef3",
"branch": "main",
"remote": "https://github.com/adieyal/sd-dynamic-prompts.git"
},
{
"name": "sd-extension-system-info",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-extension-system-info",
"version": "363d4417",
"branch": "main",
"remote": "https://github.com/vladmandic/sd-extension-system-info.git"
},
{
"name": "sd-webui-animatediff",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-animatediff",
"version": "e9db9f28",
"branch": "master",
"remote": "https://github.com/continue-revolution/sd-webui-animatediff.git"
},
{
"name": "sd-webui-aspect-ratio-helper",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-aspect-ratio-helper",
"version": "99fcf9b0",
"branch": "main",
"remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git"
},
{
"name": "sd-webui-cads",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-cads",
"version": "a821b207",
"branch": "main",
"remote": "https://github.com/v0xie/sd-webui-cads.git"
},
{
"name": "sd-webui-inpaint-anything",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-inpaint-anything",
"version": "a08995a7",
"branch": "main",
"remote": "https://github.com/Uminosachi/sd-webui-inpaint-anything.git"
},
{
"name": "sd-webui-model-mixer",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-model-mixer",
"version": "519beda8",
"branch": "master",
"remote": "https://github.com/wkpark/sd-webui-model-mixer.git"
},
{
"name": "sd-webui-mosaic-outpaint",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-mosaic-outpaint",
"version": "709c60ac",
"branch": "main",
"remote": "https://github.com/Haoming02/sd-webui-mosaic-outpaint.git"
},
{
"name": "sd-webui-stablesr",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-stablesr",
"version": "4499d796",
"branch": "master",
"remote": "https://github.com/pkuliyi2015/sd-webui-stablesr.git"
},
{
"name": "sd-webui-zmultidiffusion-upscaler-for-automatic1111",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-zmultidiffusion-upscaler-for-automatic1111",
"version": "fbb24736",
"branch": "main",
"remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git"
},
{
"name": "stable-diffusion-webui-model-toolkit",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\stable-diffusion-webui-model-toolkit",
"version": "cf824587",
"branch": "master",
"remote": "https://github.com/arenasys/stable-diffusion-webui-model-toolkit.git"
},
{
"name": "stable-diffusion-webui-rembg",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\stable-diffusion-webui-rembg",
"version": "a4c07b85",
"branch": "master",
"remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git"
}
],
"Inactive extensions": [
{
"name": "extension-style-vars",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\extension-style-vars",
"version": "7e528995",
"branch": "master",
"remote": "https://github.com/SirVeggie/extension-style-vars"
},
{
"name": "sd-webui-replacer",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-replacer",
"version": "6f8b5807",
"branch": "master",
"remote": "https://github.com/light-and-ray/sd-webui-replacer.git"
},
{
"name": "ultimate-upscale-for-automatic1111",
"path": "D:\\stable-diffusion-webui-forge\\extensions\\ultimate-upscale-for-automatic1111",
"version": "728ffcec",
"branch": "master",
"remote": "https://github.com/Coyote-A/ultimate-upscale-for-automatic1111.git"
}
],
"Environment": {
"COMMANDLINE_ARGS": "--ckpt-dir \"e:\\stable Diffusion Checkpoints\"",
"GRADIO_ANALYTICS_ENABLED": "False"
},
"Config": {
"ldsr_steps": 100,
"ldsr_cached": false,
"SCUNET_tile": 256,
"SCUNET_tile_overlap": 8,
"SWIN_tile": 192,
"SWIN_tile_overlap": 8,
"SWIN_torch_compile": false,
"control_net_detectedmap_dir": "detected_maps",
"control_net_models_path": "D:\\stable-diffusion-webui\\extensions\\3sd-webui-controlnet",
"control_net_modules_path": "",
"control_net_unit_count": 3,
"control_net_model_cache_size": 3,
"control_net_no_detectmap": false,
"control_net_detectmap_autosaving": false,
"control_net_allow_script_control": true,
"control_net_sync_field_args": true,
"controlnet_show_batch_images_in_ui": false,
"controlnet_increment_seed_during_batch": false,
"controlnet_disable_openpose_edit": false,
"controlnet_disable_photopea_edit": false,
"controlnet_photopea_warning": true,
"controlnet_input_thumbnail": true,
"sd_checkpoint_hash": "31e35c80fc4829d14f90153f4c74cd59c90b779f6afe05a74cd6120b893f7e5b",
"sd_model_checkpoint": "SDXL\\sd_xl_base_1.0.safetensors [31e35c80fc]",
"outdir_samples": "E:\\Stable Diffusion Images",
"outdir_txt2img_samples": "E:\\Stable Diffusion Images",
"outdir_img2img_samples": "E:\\Stable Diffusion Images",
"outdir_extras_samples": "E:\\Stable Diffusion Images",
"outdir_grids": "E:\\Stable Diffusion Images",
"outdir_txt2img_grids": "E:\\Stable Diffusion Images",
"outdir_img2img_grids": "E:\\Stable Diffusion Images",
"outdir_save": "E:\\Stable Diffusion Images",
"outdir_init_images": "E:\\Stable Diffusion Images",
"samples_save": true,
"samples_format": "png",
"samples_filename_pattern": "",
"save_images_add_number": true,
"save_images_replace_action": "Replace",
"grid_save": true,
"grid_format": "png",
"grid_extended_filename": false,
"grid_only_if_multiple": true,
"grid_prevent_empty_spots": false,
"grid_zip_filename_pattern": "",
"n_rows": -1,
"font": "",
"grid_text_active_color": "#000000",
"grid_text_inactive_color": "#999999",
"grid_background_color": "#ffffff",
"save_images_before_face_restoration": false,
"save_images_before_highres_fix": false,
"save_images_before_color_correction": false,
"save_mask": false,
"save_mask_composite": false,
"jpeg_quality": 80,
"webp_lossless": false,
"export_for_4chan": true,
"img_downscale_threshold": 4.0,
"target_side_length": 4000.0,
"img_max_size_mp": 200.0,
"use_original_name_batch": true,
"use_upscaler_name_as_suffix": false,
"save_selected_only": true,
"save_init_img": false,
"temp_dir": "",
"clean_temp_dir_at_start": false,
"save_incomplete_images": false,
"notification_audio": true,
"notification_volume": 100,
"save_to_dirs": true,
"grid_save_to_dirs": true,
"use_save_to_dirs_for_ui": false,
"directories_filename_pattern": "[date]",
"directories_max_prompt_words": 8,
"auto_backcompat": true,
"use_old_emphasis_implementation": false,
"use_old_karras_scheduler_sigmas": false,
"no_dpmpp_sde_batch_determinism": false,
"use_old_hires_fix_width_height": false,
"dont_fix_second_order_samplers_schedule": false,
"hires_fix_use_firstpass_conds": false,
"use_old_scheduling": false,
"use_downcasted_alpha_bar": false,
"lora_functional": false,
"extra_networks_show_hidden_directories": true,
"extra_networks_dir_button_function": false,
"extra_networks_hidden_models": "When searched",
"extra_networks_default_multiplier": 1,
"extra_networks_card_width": 0.0,
"extra_networks_card_height": 0.0,
"extra_networks_card_text_scale": 1,
"extra_networks_card_show_desc": true,
"extra_networks_card_order_field": "Path",
"extra_networks_card_order": "Ascending",
"extra_networks_tree_view_default_enabled": false,
"extra_networks_add_text_separator": " ",
"ui_extra_networks_tab_reorder": "",
"textual_inversion_print_at_load": false,
"textual_inversion_add_hashes_to_infotext": true,
"sd_hypernetwork": "None",
"sd_lora": "None",
"lora_preferred_name": "Alias from file",
"lora_add_hashes_to_infotext": true,
"lora_show_all": false,
"lora_hide_unknown_for_versions": [],
"lora_in_memory_limit": 0,
"lora_not_found_warning_console": false,
"lora_not_found_gradio_warning": false,
"cross_attention_optimization": "Automatic",
"s_min_uncond": 0,
"token_merging_ratio": 0,
"token_merging_ratio_img2img": 0,
"token_merging_ratio_hr": 0,
"pad_cond_uncond": false,
"pad_cond_uncond_v0": false,
"persistent_cond_cache": true,
"batch_cond_uncond": true,
"fp8_storage": "Disable",
"cache_fp16_weight": false,
"hide_samplers": [],
"eta_ddim": 0,
"eta_ancestral": 1,
"ddim_discretize": "uniform",
"s_churn": 0,
"s_tmin": 0,
"s_tmax": 0,
"s_noise": 1,
"k_sched_type": "Automatic",
"sigma_min": 0.0,
"sigma_max": 0.0,
"rho": 0.0,
"eta_noise_seed_delta": 0,
"always_discard_next_to_last_sigma": false,
"sgm_noise_multiplier": false,
"uni_pc_variant": "bh1",
"uni_pc_skip_type": "time_uniform",
"uni_pc_order": 3,
"uni_pc_lower_order_final": true,
"sd_noise_schedule": "Default",
"sd_checkpoints_limit": 1,
"sd_checkpoints_keep_in_cpu": true,
"sd_checkpoint_cache": 0,
"sd_unet": "Automatic",
"enable_quantization": false,
"enable_emphasis": true,
"enable_batch_seeds": true,
"comma_padding_backtrack": 20,
"upcast_attn": false,
"randn_source": "GPU",
"tiling": false,
"hires_fix_refiner_pass": "second pass",
"sdxl_crop_top": 0.0,
"sdxl_crop_left": 0.0,
"sdxl_refiner_low_aesthetic_score": 2.5,
"sdxl_refiner_high_aesthetic_score": 6.0,
"sd_vae_checkpoint_cache": 0,
"sd_vae_overrides_per_model_preferences": true,
"auto_vae_precision_bfloat16": false,
"auto_vae_precision": true,
"sd_vae_encode_method": "Full",
"sd_vae_decode_method": "Full",
"inpainting_mask_weight": 1,
"initial_noise_multiplier": 1,
"img2img_extra_noise": 0,
"img2img_color_correction": false,
"img2img_fix_steps": false,
"img2img_background_color": "#ffffff",
"img2img_editor_height": 720,
"img2img_sketch_default_brush_color": "#ffffff",
"img2img_inpaint_mask_brush_color": "#ffffff",
"img2img_inpaint_sketch_default_brush_color": "#ffffff",
"return_mask": false,
"return_mask_composite": false,
"img2img_batch_show_results_limit": 32,
"overlay_inpaint": true,
"return_grid": true,
"do_not_show_images": false,
"js_modal_lightbox": true,
"js_modal_lightbox_initially_zoomed": true,
"js_modal_lightbox_gamepad": false,
"js_modal_lightbox_gamepad_repeat": 250.0,
"sd_webui_modal_lightbox_icon_opacity": 1,
"sd_webui_modal_lightbox_toolbar_opacity": 0.9,
"gallery_height": "",
"enable_pnginfo": true,
"save_txt": false,
"add_model_name_to_info": true,
"add_model_hash_to_info": true,
"add_vae_name_to_info": true,
"add_vae_hash_to_info": true,
"add_user_name_to_info": false,
"add_version_to_infotext": true,
"disable_weights_auto_swap": true,
"infotext_skip_pasting": [],
"infotext_styles": "Apply if any",
"show_progressbar": true,
"live_previews_enable": true,
"live_previews_image_format": "png",
"show_progress_grid": false,
"show_progress_every_n_steps": -1,
"show_progress_type": "Full",
"live_preview_allow_lowvram_full": false,
"live_preview_content": "Combined",
"live_preview_refresh_period": 1000.0,
"live_preview_fast_interrupt": true,
"js_live_preview_in_modal_lightbox": true,
"keyedit_precision_attention": 0.1,
"keyedit_precision_extra": 0.05,
"keyedit_delimiters": ".,\\/!?%^*;:{}=`~() ",
"keyedit_delimiters_whitespace": [
"Tab",
"Carriage Return",
"Line Feed"
],
"keyedit_move": true,
"disable_token_counters": false,
"extra_options_txt2img": [],
"extra_options_img2img": [],
"extra_options_cols": 1,
"extra_options_accordion": false,
"compact_prompt_box": false,
"samplers_in_dropdown": true,
"dimensions_and_batch_together": true,
"sd_checkpoint_dropdown_use_short": false,
"hires_fix_show_sampler": false,
"hires_fix_show_prompts": false,
"txt2img_settings_accordion": false,
"img2img_settings_accordion": false,
"interrupt_after_current": true,
"localization": "None",
"quicksettings_list": [
"sd_model_checkpoint",
"sd_vae",
"CLIP_stop_at_last_layers"
],
"ui_tab_order": [],
"hidden_tabs": [],
"ui_reorder_list": [],
"gradio_theme": "Default",
"gradio_themes_cache": true,
"show_progress_in_title": true,
"send_seed": true,
"send_size": true,
"api_enable_requests": true,
"api_forbid_local_requests": true,
"api_useragent": "",
"auto_launch_browser": "Local",
"enable_console_prompts": false,
"show_warnings": false,
"show_gradio_deprecation_warnings": true,
"memmon_poll_rate": 8,
"samples_log_stdout": false,
"multiple_tqdm": true,
"enable_upscale_progressbar": true,
"print_hypernet_extra": false,
"list_hidden_files": true,
"disable_mmap_load_safetensors": false,
"hide_ldm_prints": true,
"dump_stacks_on_signal": false,
"face_restoration": false,
"face_restoration_model": "CodeFormer",
"code_former_weight": 0.5,
"face_restoration_unload": false,
"postprocessing_enable_in_main_ui": [],
"postprocessing_operation_order": [],
"upscaling_max_images_in_cache": 5,
"postprocessing_existing_caption_action": "Ignore",
"ESRGAN_tile": 192,
"ESRGAN_tile_overlap": 8,
"realesrgan_enabled_models": [
"R-ESRGAN 4x+",
"R-ESRGAN 4x+ Anime6B"
],
"dat_enabled_models": [
"DAT x2",
"DAT x3",
"DAT x4"
],
"DAT_tile": 192,
"DAT_tile_overlap": 8,
"unload_models_when_training": false,
"pin_memory": false,
"save_optimizer_state": false,
"save_training_settings_to_txt": true,
"dataset_filename_word_regex": "",
"dataset_filename_join_string": " ",
"training_image_repeats_per_epoch": 1,
"training_write_csv_every": 500.0,
"training_xattention_optimizations": false,
"training_enable_tensorboard": false,
"training_tensorboard_save_images": false,
"training_tensorboard_flush_every": 120.0,
"canvas_hotkey_zoom": "Alt",
"canvas_hotkey_adjust": "Ctrl",
"canvas_hotkey_shrink_brush": "Q",
"canvas_hotkey_grow_brush": "W",
"canvas_hotkey_move": "F",
"canvas_hotkey_fullscreen": "S",
"canvas_hotkey_reset": "R",
"canvas_hotkey_overlap": "O",
"canvas_show_tooltip": true,
"canvas_auto_expand": true,
"canvas_blur_prompt": false,
"canvas_disabled_functions": [
"Overlap"
],
"interrogate_keep_models_in_memory": false,
"interrogate_return_ranks": false,
"interrogate_clip_num_beams": 1,
"interrogate_clip_min_length": 24,
"interrogate_clip_max_length": 48,
"interrogate_clip_dict_limit": 1500.0,
"interrogate_clip_skip_categories": [],
"interrogate_deepbooru_score_threshold": 0.5,
"deepbooru_sort_alpha": true,
"deepbooru_use_spaces": true,
"deepbooru_escape": true,
"deepbooru_filter_tags": "",
"control_net_inpaint_blur_sigma": 7,
"controlnet_ignore_noninpaint_mask": false,
"controlnet_clip_detector_on_cpu": false,
"ad_max_models": 2,
"ad_extra_models_dir": "D:\\stable-diffusion-webui\\models",
"ad_save_previews": false,
"ad_save_images_before": false,
"ad_only_seleted_scripts": true,
"ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight,negpip",
"ad_bbox_sortby": "None",
"ad_same_seed_for_each_tap": false,
"tac_tagFile": "danbooru.csv",
"tac_active": true,
"tac_activeIn.txt2img": true,
"tac_activeIn.img2img": true,
"tac_activeIn.negativePrompts": true,
"tac_activeIn.thirdParty": true,
"tac_activeIn.modelList": "",
"tac_activeIn.modelListMode": "Blacklist",
"tac_slidingPopup": true,
"tac_maxResults": 5,
"tac_showAllResults": false,
"tac_resultStepLength": 100,
"tac_delayTime": 100,
"tac_useWildcards": true,
"tac_sortWildcardResults": true,
"tac_wildcardExclusionList": "",
"tac_skipWildcardRefresh": false,
"tac_useEmbeddings": true,
"tac_includeEmbeddingsInNormalResults": false,
"tac_useHypernetworks": true,
"tac_useLoras": true,
"tac_useLycos": true,
"tac_useLoraPrefixForLycos": true,
"tac_showWikiLinks": false,
"tac_showExtraNetworkPreviews": true,
"tac_modelSortOrder": "Name",
"tac_useStyleVars": false,
"tac_replaceUnderscores": true,
"tac_escapeParentheses": true,
"tac_appendComma": true,
"tac_appendSpace": true,
"tac_alwaysSpaceAtEnd": true,
"tac_modelKeywordCompletion": "Never",
"tac_modelKeywordLocation": "Start of prompt",
"tac_wildcardCompletionMode": "To next folder level",
"tac_alias.searchByAlias": true,
"tac_alias.onlyShowAlias": false,
"tac_translation.translationFile": "None",
"tac_translation.oldFormat": false,
"tac_translation.searchByTranslation": true,
"tac_translation.liveTranslation": false,
"tac_extra.extraFile": "extra-quality-tags.csv",
"tac_extra.addMode": "Insert before",
"tac_chantFile": "demo-chants.json",
"tac_keymap": "{\n \"MoveUp\": \"ArrowUp\",\n \"MoveDown\": \"ArrowDown\",\n \"JumpUp\": \"PageUp\",\n \"JumpDown\": \"PageDown\",\n \"JumpToStart\": \"Home\",\n \"JumpToEnd\": \"End\",\n \"ChooseSelected\": \"Enter\",\n \"ChooseFirstOrSelected\": \"Tab\",\n \"Close\": \"Escape\"\n}",
"tac_colormap": "{\n \"danbooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"indianred\", \"firebrick\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"orange\", \"darkorange\"]\n },\n \"e621\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"gold\", \"goldenrod\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"tomato\", \"darksalmon\"],\n \"6\": [\"red\", \"maroon\"],\n \"7\": [\"whitesmoke\", \"black\"],\n \"8\": [\"seagreen\", \"darkseagreen\"]\n }\n}",
"tac_refreshTempFiles": "Refresh TAC temp files",
"style_vars_enabled": true,
"style_vars_random": false,
"style_vars_hires": false,
"style_vars_linebreaks": true,
"style_vars_info": true,
"polotno_api_key": "bHEpG9Rp0Nq9XrLcwFNu",
"canvas_editor_default_width": 1024,
"canvas_editor_default_height": 1024,
"animatediff_model_path": "",
"animatediff_optimize_gif_palette": false,
"animatediff_optimize_gif_gifsicle": false,
"animatediff_mp4_crf": 23,
"animatediff_mp4_preset": "",
"animatediff_mp4_tune": "",
"animatediff_webp_quality": 80,
"animatediff_webp_lossless": false,
"animatediff_save_to_custom": false,
"animatediff_xformers": "Optimize attention layers with xformers",
"animatediff_disable_lcm": false,
"animatediff_s3_enable": false,
"animatediff_s3_host": "",
"animatediff_s3_port": "",
"animatediff_s3_access_key": "",
"animatediff_s3_secret_key": "",
"animatediff_s3_storge_bucket": "",
"arh_javascript_aspect_ratio_show": true,
"arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9",
"arh_ui_javascript_selection_method": "Aspect Ratios Dropdown",
"arh_hide_accordion_by_default": true,
"arh_expand_by_default": false,
"arh_ui_component_order_key": "MaxDimensionScaler, MinDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons",
"arh_show_max_width_or_height": false,
"arh_max_width_or_height": 1024.0,
"arh_show_min_width_or_height": false,
"arh_min_width_or_height": 1024.0,
"arh_show_predefined_aspect_ratios": false,
"arh_predefined_aspect_ratio_use_max_dim": false,
"arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9",
"arh_show_predefined_percentages": false,
"arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200",
"arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)",
"freeu_png_info_auto_enable": true,
"inpaint_anything_save_folder": "inpaint-anything",
"inpaint_anything_sam_oncpu": false,
"inpaint_anything_offline_inpainting": false,
"inpaint_anything_padding_fill": 127,
"inpain_anything_sam_models_dir": "",
"mm_max_models": 3,
"mm_debugs": [
"elemental merge"
],
"mm_save_model": [
"safetensors",
"fp16",
"prune",
"overwrite"
],
"mm_save_model_filename": "modelmixer-[hash]",
"mm_use_extra_elements": true,
"mm_use_old_finetune": false,
"mm_use_unet_partial_update": true,
"mm_laplib": "lap",
"mm_use_fast_weighted_sum": true,
"mm_use_precalculate_hash": false,
"mm_use_model_dl": false,
"mm_default_config_lock": false,
"mm_civitai_api_key": "",
"replacer_use_first_positive_prompt_from_examples": true,
"replacer_use_first_negative_prompt_from_examples": true,
"replacer_hide_segment_anything_accordions": false,
"replacer_always_unload_models": "Automatic",
"replacer_detection_prompt_examples": "",
"replacer_avoidance_prompt_examples": "",
"replacer_positive_prompt_examples": "",
"replacer_negative_prompt_examples": "",
"replacer_hf_positive_prompt_suffix_examples": "",
"replacer_examples_per_page_for_detection_prompt": 10,
"replacer_examples_per_page_for_avoidance_prompt": 10,
"replacer_examples_per_page_for_positive_prompt": 10,
"replacer_examples_per_page_for_negative_prompt": 10,
"replacer_save_dir": "outputs\\replacer",
"model_toolkit_fix_clip": false,
"model_toolkit_autoprune": false,
"dp_ignore_whitespace": false,
"dp_write_raw_template": false,
"dp_write_prompts_to_file": false,
"dp_parser_variant_start": "{",
"dp_parser_variant_end": "}",
"dp_parser_wildcard_wrap": "__",
"dp_limit_jinja_prompts": false,
"dp_auto_purge_cache": false,
"dp_wildcard_manager_no_dedupe": false,
"dp_wildcard_manager_no_sort": false,
"dp_wildcard_manager_shuffle": false,
"dp_magicprompt_default_model": "Gustavosta/MagicPrompt-Stable-Diffusion",
"dp_magicprompt_batch_size": 1,
"disabled_extensions": [
"extension-style-vars",
"sd-webui-freeu",
"sd-webui-replacer",
"ultimate-upscale-for-automatic1111"
],
"disable_all_extensions": "none",
"sd_vae": "sdxl_vae.safetensors",
"CLIP_stop_at_last_layers": 1
},
"Startup": {
"total": 2.6610946655273438,
"records": {
"app reload callback": 0.0,
"scripts unloaded callback": 0.0,
"set samplers": 0.0,
"list extensions": 0.011959075927734375,
"restore config state file": 0.0,
"list SD models": 0.21428275108337402,
"list localizations": 0.0009968280792236328,
"load scripts/custom_code.py": 0.0029897689819335938,
"load scripts/img2imgalt.py": 0.0,
"load scripts/loopback.py": 0.0,
"load scripts/outpainting_mk_2.py": 0.0009970664978027344,
"load scripts/poor_mans_outpainting.py": 0.0,
"load scripts/postprocessing_caption.py": 0.0,
"load scripts/postprocessing_codeformer.py": 0.0,
"load scripts/postprocessing_create_flipped_copies.py": 0.0,
"load scripts/postprocessing_focal_crop.py": 0.0,
"load scripts/postprocessing_gfpgan.py": 0.0,
"load scripts/postprocessing_split_oversized.py": 0.0,
"load scripts/postprocessing_upscale.py": 0.0,
"load scripts/processing_autosized_crop.py": 0.0,
"load scripts/prompt_matrix.py": 0.0,
"load scripts/prompts_from_file.py": 0.0009965896606445312,
"load scripts/sd_upscale.py": 0.0,
"load scripts/xyz_grid.py": 0.0,
"load scripts/ldsr_model.py": 0.03388643264770508,
"load scripts/lora_script.py": 0.05880308151245117,
"load scripts/scunet_model.py": 0.009966611862182617,
"load scripts/swinir_model.py": 0.009966850280761719,
"load scripts/hotkey_config.py": 0.0,
"load scripts/extra_options_section.py": 0.0,
"load scripts/legacy_preprocessors.py": 0.0,
"load scripts/preprocessor_inpaint.py": 0.0,
"load scripts/preprocessor_marigold.py": 0.0009965896606445312,
"load scripts/preprocessor_normalbae.py": 0.0,
"load scripts/preprocessor_recolor.py": 0.0,
"load scripts/forge_reference.py": 0.0,
"load scripts/preprocessor_revision.py": 0.0,
"load scripts/preprocessor_tile.py": 0.0,
"load scripts/forge_controllllite.py": 0.0,
"load scripts/controlnet.py": 0.06777334213256836,
"load scripts/xyz_grid_support.py": 0.0,
"load scripts/sd_forge_controlnet_example.py": 0.0,
"load scripts/forge_freeu.py": 0.0,
"load scripts/forge_hypertile.py": 0.0,
"load scripts/forge_ipadapter.py": 0.0009968280792236328,
"load scripts/kohya_hrfix.py": 0.0,
"load scripts/forge_photomaker.py": 0.0,
"load scripts/forge_sag.py": 0.0,
"load scripts/forge_stylealign.py": 0.0,
"load scripts/forge_svd.py": 0.009966611862182617,
"load scripts/forge_z123.py": 0.009966611862182617,
"load scripts/soft_inpainting.py": 0.0009965896606445312,
"load scripts/!adetailer.py": 0.5700924396514893,
"load scripts/model_keyword_support.py": 0.0009965896606445312,
"load scripts/shared_paths.py": 0.0,
"load scripts/tag_autocomplete_helper.py": 0.07175993919372559,
"load scripts/frame2frame.py": 0.0,
"load scripts/sd_tag_batch.py": 0.0,
"load scripts/main.py": 0.019933223724365234,
"load scripts/dynamic_prompting.py": 0.0,
"load scripts/system-info.py": 0.020930051803588867,
"load scripts/animatediff.py": 0.03886985778808594,
"load scripts/animatediff_cn.py": 0.0,
"load scripts/animatediff_i2ibatch.py": 0.0,
"load scripts/animatediff_infotext.py": 0.0009965896606445312,
"load scripts/animatediff_infv2v.py": 0.0,
"load scripts/animatediff_latent.py": 0.0,
"load scripts/animatediff_lcm.py": 0.0,
"load scripts/animatediff_logger.py": 0.0,
"load scripts/animatediff_lora.py": 0.0,
"load scripts/animatediff_mm.py": 0.0,
"load scripts/animatediff_output.py": 0.0009965896606445312,
"load scripts/animatediff_prompt.py": 0.0,
"load scripts/animatediff_ui.py": 0.0,
"load scripts/sd_webui_aspect_ratio_helper.py": 0.0,
"load scripts/cads.py": 0.009966850280761719,
"load scripts/inpaint_anything.py": 0.019933223724365234,
"load scripts/model_mixer.py": 0.05880331993103027,
"load scripts/patches.py": 0.0,
"load scripts/vxa.py": 0.0009965896606445312,
"load scripts/mos_processing.py": 0.0,
"load scripts/mosaic.py": 0.008970022201538086,
"load scripts/stablesr.py": 0.0009965896606445312,
"load scripts/tilediffusion.py": 0.0,
"load scripts/tilevae.py": 0.0,
"load scripts/toolkit_gui.py": 0.030896663665771484,
"load scripts/api.py": 0.01096343994140625,
"load scripts/postprocessing_rembg.py": 0.0,
"load scripts/refiner.py": 0.0,
"load scripts/seed.py": 0.0,
"load scripts": 1.0744049549102783,
"reload script modules": 0.01793980598449707,
"load upscalers": 0.0009968280792236328,
"refresh VAE": 0.11262297630310059,
"refresh textual inversion templates": 0.0009965896606445312,
"scripts list_optimizers": 0.0,
"scripts list_unets": 0.0,
"reload hypernetworks": 0.0009968280792236328,
"initialize extra networks": 0.0,
"scripts before_ui_callback": 0.0009965896606445312,
"create ui": 0.8979952335357666,
"gradio launch": 0.23321962356567383,
"add APIs": 0.0019936561584472656,
"app_started_callback/lora_script.py": 0.0,
"app_started_callback/!adetailer.py": 0.0,
"app_started_callback/tag_autocomplete_helper.py": 0.0009965896606445312,
"app_started_callback/system-info.py": 0.0019931793212890625,
"app_started_callback/model_mixer.py": 0.08870315551757812,
"app_started_callback/api.py": 0.0,
"app_started_callback": 0.09169292449951172
}
},
"Packages": [
"absl-py==2.1.0",
"accelerate==0.21.0",
"addict==2.4.0",
"aenum==3.1.15",
"aiofiles==23.2.1",
"aiohttp==3.9.3",
"aiosignal==1.3.1",
"albumentations==1.3.1",
"altair==5.2.0",
"antlr4-python3-runtime==4.9.3",
"anyio==3.7.1",
"async-timeout==4.0.3",
"attrs==23.2.0",
"av==11.0.0",
"basicsr==1.4.2",
"bidict==0.22.1",
"blendmodes==2022",
"certifi==2024.2.2",
"cffi==1.16.0",
"chardet==5.2.0",
"charset-normalizer==3.3.2",
"clean-fid==0.1.35",
"click==8.1.7",
"clip==1.0",
"colorama==0.4.6",
"coloredlogs==15.0.1",
"colorlog==6.8.2",
"contourpy==1.2.0",
"controlnet-aux==0.0.3",
"cssselect2==0.7.0",
"cycler==0.12.1",
"cython==3.0.8",
"decorator==4.0.11",
"deprecation==2.1.0",
"depth-anything==2024.1.22.0",
"diffusers==0.25.0",
"dynamicprompts==0.30.4",
"easydict==1.11",
"einops==0.4.1",
"embreex==2.17.7.post4",
"exceptiongroup==1.2.0",
"facexlib==0.3.0",
"fastapi==0.94.0",
"ffmpy==0.3.1",
"filelock==3.13.1",
"filterpy==1.4.5",
"flask-cors==4.0.0",
"flask-socketio==5.3.6",
"flask==2.2.3",
"flaskwebgui==0.3.5",
"flatbuffers==23.5.26",
"fonttools==4.47.2",
"frozenlist==1.4.1",
"fsspec==2024.2.0",
"ftfy==6.1.3",
"future==0.18.3",
"fvcore==0.1.5.post20221221",
"gitdb==4.0.11",
"gitpython==3.1.32",
"gradio-client==0.5.0",
"gradio==3.41.2",
"grpcio==1.60.1",
"h11==0.12.0",
"handrefinerportable==2024.1.18.0",
"httpcore==0.15.0",
"httpx==0.24.1",
"huggingface-hub==0.20.3",
"humanfriendly==10.0",
"idna==3.6",
"imageio-ffmpeg==0.4.9",
"imageio==2.33.1",
"importlib-metadata==7.0.1",
"importlib-resources==6.1.1",
"inflection==0.5.1",
"insightface==0.7.3",
"iopath==0.1.9",
"itsdangerous==2.1.2",
"jinja2==3.1.3",
"joblib==1.3.2",
"jsonmerge==1.8.0",
"jsonschema-specifications==2023.12.1",
"jsonschema==4.21.1",
"kiwisolver==1.4.5",
"kornia==0.6.7",
"lama-cleaner==1.2.5",
"lark==1.1.2",
"lazy-loader==0.3",
"lightning-utilities==0.10.1",
"llvmlite==0.42.0",
"lmdb==1.4.1",
"loguru==0.7.2",
"lxml==5.1.0",
"mapbox-earcut==1.0.1",
"markdown-it-py==3.0.0",
"markdown==3.5.2",
"markupsafe==2.1.5",
"matplotlib==3.8.2",
"mdurl==0.1.2",
"mediapipe==0.10.9",
"moviepy==0.2.3.2",
"mpmath==1.3.0",
"multidict==6.0.5",
"networkx==3.2.1",
"numba==0.59.0",
"numpy==1.26.2",
"omegaconf==2.2.3",
"onnx==1.15.0",
"onnxruntime==1.17.0",
"open-clip-torch==2.20.0",
"opencv-contrib-python==4.9.0.80",
"opencv-python-headless==4.9.0.80",
"opencv-python==4.9.0.80",
"orjson==3.9.13",
"packaging==23.2",
"pandas==2.2.0",
"piexif==1.1.3",
"pillow==9.5.0",
"pip==22.2.1",
"platformdirs==4.2.0",
"pooch==1.8.0",
"portalocker==2.8.2",
"prettytable==3.9.0",
"protobuf==3.20.3",
"psutil==5.9.5",
"py-cpuinfo==9.0.0",
"pycollada==0.8",
"pycparser==2.21",
"pydantic==1.10.14",
"pydub==0.25.1",
"pygments==2.17.2",
"pymatting==1.1.12",
"pyparsing==3.1.1",
"pyreadline3==3.4.1",
"python-dateutil==2.8.2",
"python-engineio==4.9.0",
"python-multipart==0.0.7",
"python-socketio==5.11.1",
"pytorch-lightning==1.9.4",
"pytz==2024.1",
"pywavelets==1.5.0",
"pywin32==306",
"pyyaml==6.0.1",
"qudida==0.0.4",
"referencing==0.33.0",
"regex==2023.12.25",
"rembg==2.0.50",
"reportlab==4.0.9",
"requests==2.31.0",
"resize-right==0.0.2",
"rich==13.7.0",
"rpds-py==0.17.1",
"rtree==1.2.0",
"safetensors==0.4.2",
"scikit-image==0.21.0",
"scikit-learn==1.4.0",
"scipy==1.12.0",
"seaborn==0.13.2",
"segment-anything==1.0",
"semantic-version==2.10.0",
"send2trash==1.8.2",
"sentencepiece==0.1.99",
"setuptools==63.2.0",
"shapely==2.0.2",
"simple-websocket==1.0.0",
"six==1.16.0",
"smmap==5.0.1",
"sniffio==1.3.0",
"sounddevice==0.4.6",
"spandrel==0.1.6",
"starlette==0.26.1",
"svg.path==6.3",
"svglib==1.5.1",
"sympy==1.12",
"tabulate==0.9.0",
"tb-nightly==2.16.0a20240205",
"tensorboard-data-server==0.7.2",
"termcolor==2.4.0",
"tf-keras-nightly==2.16.0.dev2024020510",
"thop==0.1.1.post2209072238",
"threadpoolctl==3.2.0",
"tifffile==2024.1.30",
"timm==0.9.12",
"tinycss2==1.2.1",
"tokenizers==0.13.3",
"tomesd==0.1.3",
"tomli==2.0.1",
"toolz==0.12.1",
"torch==2.1.2+cu121",
"torchdiffeq==0.2.3",
"torchmetrics==1.3.0.post0",
"torchsde==0.2.6",
"torchvision==0.16.2+cu121",
"tqdm==4.66.1",
"trampoline==0.1.2",
"transformers==4.30.2",
"trimesh==4.1.3",
"typing-extensions==4.9.0",
"tzdata==2023.4",
"ultralytics==8.1.9",
"urllib3==2.2.0",
"uvicorn==0.27.0.post1",
"vhacdx==0.0.5",
"wcwidth==0.2.13",
"webencodings==0.5.1",
"websockets==11.0.3",
"werkzeug==2.2.2",
"whichcraft==0.6.1",
"win32-setctime==1.1.0",
"wsproto==1.2.0",
"xxhash==3.4.1",
"yacs==0.1.8",
"yapf==0.40.2",
"yarl==1.9.4",
"zipp==3.17.0"
]
}
Note that photomaker is a special control that need you to add the trigger word "photomaker"
Your prompt should be like "a photo of photomaker"
clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.
clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.
Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main
clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.
Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main
yes. It is a cn model,not a preprocessor.
I have the same issue. Photomaker CN doesn't seem to work at all. I used "a photo of photomaker" prompt and Photomaker-v1.bin CN. I have this error on cmd when using it, doesn't happen with other CNs:
"Warning torch.load doesn't support weights_only on this pytorch version, loading unsafely."
Also not working for me, the image does not change after enabling photomaker with photomaker bin model plus Photomaker in the prompt, same output
I think there is a problem, when using the required "a photo of photomaker" if a "," is just next to it for example: "a photo of photomaker, a woman in astronaut suit" that coma is ruining the activation.
I also noticed that photomaker does work when the prompt is only "a photo of photomaker". Additional words disable the effect.
Photomaker github recommends a different trigger word. I'm AFK but maybe someone can test to see if changes something.
(From their github)
Note that the trigger word img must follow the class word for personalization
prompt = "a half-body portrait of a man img wearing the sunglasses in Iron man suit, best quality" negative_prompt = "(asymmetry, worst quality, low quality, illustration, 3d, 2d, painting, cartoons, sketch), open mouth, grayscale" generator = torch.Generator(device=device).manual_seed(42) images = pipe( prompt=prompt, input_id_images=input_id_images, negative_prompt=negative_prompt, num_images_per_prompt=1, num_inference_steps=num_steps, start_merge_step=10, generator=generator, ).images[0] gen_images.save('out_photomaker.png')
clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.
Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main
Thanks.... and where do we put this file?
clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.
Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main
Thanks.... and where do we put this file?
Inside the models/controlnet folder
I also noticed that photomaker does work when the prompt is only "a photo of photomaker". Additional words disable the effect.
Photomaker github recommends a different trigger word. I'm AFK but maybe someone can test to see if changes something.
(From their github)
Note that the trigger word
imgmust follow the class word for personalizationprompt = "a half-body portrait of a man img wearing the sunglasses in Iron man suit, best quality" negative_prompt = "(asymmetry, worst quality, low quality, illustration, 3d, 2d, painting, cartoons, sketch), open mouth, grayscale" generator = torch.Generator(device=device).manual_seed(42) images = pipe( prompt=prompt, input_id_images=input_id_images, negative_prompt=negative_prompt, num_images_per_prompt=1, num_inference_steps=num_steps, start_merge_step=10, generator=generator, ).images[0] gen_images.save('out_photomaker.png')
The "img" alone didn't work, "photomaker" alone didn't work, only "a photo of photomaker" works, at least in my test.
So, after some experimentation, I found that:
- It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
- Adjusting the control net weight does very little (this is fine).
- You need to use the trigger word "photomaker" in the prompt.
- You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.
Example: These work:
a photo of mad scientist photomaker
a photo of mad scientist photomaker wearing a red jacket
a photo of mad scientist photomaker , wearing a green jacket
a photo of mad scientist photomaker , masterpiece, best best quality, high quality
These don't work:
a photo of mad scientist photomaker, wearing a red jacket
a photo of mad scientist photomaker, masterpiece, best best quality, high quality
@lllyasviel FYI
So, after some experimentation, I found that:
- It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
- Adjusting the control net weight does very little (this is fine).
- You need to use the trigger word "photomaker" in the prompt.
- You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.
Example: These work:
a photo of mad scientist photomaker a photo of mad scientist photomaker wearing a red jacket a photo of mad scientist photomaker , wearing a green jacket a photo of mad scientist photomaker , masterpiece, best best quality, high qualityThese don't work:
a photo of mad scientist photomaker, wearing a red jacket a photo of mad scientist photomaker, masterpiece, best best quality, high quality@lllyasviel FYI
Still doesn't work very well probably better in comfyui
So, after some experimentation, I found that:
- It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
- Adjusting the control net weight does very little (this is fine).
- You need to use the trigger word "photomaker" in the prompt.
- You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.
Example: These work:
a photo of mad scientist photomaker a photo of mad scientist photomaker wearing a red jacket a photo of mad scientist photomaker , wearing a green jacket a photo of mad scientist photomaker , masterpiece, best best quality, high qualityThese don't work:
a photo of mad scientist photomaker, wearing a red jacket a photo of mad scientist photomaker, masterpiece, best best quality, high quality@lllyasviel FYI
Still doesn't work very well probably better in comfyui
"A photo of a woman wearing a jacket img photomaker img", I used these prompt words, and the total number and total length of all prompt words cannot be too long. You can try to reduce the number or start from the length.
a photo of woman img photomaker wearing a jacket img,photo inset,solo,brown hair,bag,smile,looking at viewer,long hair,suit,skirt,formal,brown eyes,photo background,outdoors,jacket,ground vehicle,shirt,office lady,Cinematic Lighting,lora:JuggerCineXL2:1,
Also working:
the photo was shot on Kodak Ektachrome 64 film with a Nikon F SLR camera and a Nikkor f/1.4 50mm lens, shutter speed 1/250s, ISO 64. It shows a man photomaker wearing a red jacket, in the forest
It seems to me that the trigger word "photomaker" just needs a space behind it, no matter what follows afterwards. "img" is not needed as a trigger (at least in my tries).
I've noticed that it does not work when you hit "enter" after trigger word "photomaker" (if case you want to continue typing prompts in the new line). Even when there is no more prompts in new line.
So, it seem like only "space" can be used after trigger word "photomaker".
Did some quick testing as well, findings:
- As above, space after photomaker is crucial. If you don't want any further prompts, add a space then comma.
- Resize + Fill tends to work best.
- Input photomaker composition, expression, pose (if any) has a strong influence on the output. A separate controlnet pose might be useful. Trying to change it with just prompts doesn't work well.
- Race words like "asian" will overpower photomaker input and output very distinctive-generic SD faces.
- "Full" SDXL checkpoints adhere much better than Lightning (and possibly Distilled, LCM as well, didn't test those)
- Can't handle too many prompts or too long. Best to generate something close enough and inpaint the rest.
I finally got it to work. I took a screengrab from the movie "A Scanner Darkly" (rotoscoped real actors).
Photos of params used are attached. I didn't have any luck until I set cfg scale low (3.5), no independent control image (I'm using img-to-img), and the only denoise strength that would work is 0.65.
