stablediffusion icon indicating copy to clipboard operation
stablediffusion copied to clipboard

Can't do a dark/dimly lit scene/image as we could in 1.x

Open DarkAlchy opened this issue 2 years ago • 4 comments

I found this issue, and had many test it where it is a confirmed issue, a bug, or something intentional.

I do, or rather I did until 2.x rolled out, night time/dimly/dark scenes. Fireflies over a boggy dark swamp. A person creeping along in a dark alley with only a street light for illumination. A dark forest where the only light source is a dim lit cabin in the distance. Zombies, in a post apocalyptic city etc... etc... etc... In 1.x they were perfectly lit, but in came 2.x where there is always a bright light somewhere in the scene which ruins everything I do. We have all tried Textual Inversions to Hypernetworks hoping to fix this issue, and while we can get the scene's dark area darker there is ALWAYS that light. It may be invisible or visible, but it is always in the scene.

Why is this? Is it a bug because it is not on our ends it is within the model itself we, who have trained to try to go around this, feel? To be 100% honest since 75-90% of what I did involved dimly lit moody scenes if this is intentional it has ruined SD for me, so I hope it is just an oversight, or bug with the encoding.

DarkAlchy avatar Dec 09 '22 00:12 DarkAlchy

Thank you for your question. Could you show me the dark images you generated before 2.x is released?

miao-ju avatar Dec 14 '22 15:12 miao-ju

Also I would recommend negative prompting. I did "A person creeping by totally dark alley: 2.0 | light:-5.0" and it worked better. Let me know whether you get better results. Cheers!

miao-ju avatar Dec 14 '22 15:12 miao-ju

Also I would recommend negative prompting. I did "A person creeping by totally dark alley: 2.0 | light:-5.0" and it worked better. Let me know whether you get better results. Cheers!

Maybe it worked better, but there is still a light source. Emad is on the case as this is an issue that over a dozen have tried to solve, including myself, to no avail. We tried TI, HN, even DB, and it just can't do it (it got better but never perfect.). We saw VERY high loss rates of 0.6-0.8 meaning there just wasn't any dark scenes to grab in the data.

I am not sure why it always MUST inject a light (visible or not visible light source with the light always visible) from an open scene with a lone cabin at night etc... and in the bottom left it inserted a HUGE lightbulb on the ground. This sort of stuff never happened with 1.x.

DarkAlchy avatar Dec 14 '22 21:12 DarkAlchy

I just did your prompt and the light remained the same brightness.

Without the light:-5.0

image

With the negative of light:-5.0

image

As you can see the light, and lightness, did NOT change.

DarkAlchy avatar Dec 14 '22 21:12 DarkAlchy