[bug]: Upscaling not producing great results

[Jonseed]

Is there an existing issue for this problem?

• [X] I have searched the existing issues

Operating system

Windows

GPU vendor

Nvidia (CUDA)

GPU model

RTX 3060

GPU VRAM

12GB

Version number

5.0.0

Browser

Edge 129.0.2792.65 (Official build) (64-bit)

Python dependencies

{ "accelerate": "0.30.1", "compel": "2.0.2", "cuda": "12.1", "diffusers": "0.27.2", "numpy": "1.26.4", "opencv": "4.9.0.80", "onnx": "1.15.0", "pillow": "10.4.0", "python": "3.10.6", "torch": "2.2.2+cu121", "torchvision": "0.17.2+cu121", "transformers": "4.41.1", "xformers": "0.0.25.post1" }

What happened

I've done a lot of upscaling in Auto1111/Forge, and I thought I would get similar results in the new upscaling in Invoke. But that hasn't been the case. I think you've connected "creativity" to denoising and "structure" to tile controlnets, but no matter what I set these two sliders at I can't get good detailed upscaled images. And I'm using the same upscaling models that I do in Ultimate SD Upscale. In Auto/Forge, when I use SD1.5 Tile, I usually set the controlnets at the default of 1 control weight, "controlnet is more important" mode, and leave the start and end at default. I adjust how much detail to add via the denoising strength.

What you expected to happen

In Invoke whenever I adjust the creativity and structure, I never seem to get the same quality outputs that I'm used to in Auto1111/Forge. I've tried turning up the creativity high, and leaving structure at 0. I've tried turning them both up high. I've tried turning down the structure to negative, and I just get hallucinations. Nothing that I try seems to work to add subtle details when upscaling. The upscales are always a bit smoother, softer, blurrier, but never more detailed, which is what I expect going to a higher resolution. Do you have any tips or recommendations?

Maybe you could expose the controls for denoising and tile controlnets in the UI in the Advanced dropdown, so we could control these directly if the simpler creativity and structure sliders aren't working for us? I guess I could go to the workflow view, and try fiddling with the nodes.

How to reproduce the problem

Upscale any image in upscaling tab.

Additional context

By the way, In Auto/Forge I've tried upscaling with Flux as the model, and no controlnets, and I actually get really nice results just adjusting the denoising strength and upscaling models. Flux seems able to keep the context quite well even when tiling. But I can't try this in Invoke because the Flux models are disabled in the upscaling tab (probably because there are no controlnets available yet). I have noticed a new Flux upscaling controlnet model just released. Haven't tried it since controlnets aren't available in Forge yet.

Discord username

No response