ComfyUI-AutomaticCFG icon indicating copy to clipboard operation
ComfyUI-AutomaticCFG copied to clipboard

Negative prompt is included into image at low cfg

Open Arctomachine opened this issue 1 year ago • 8 comments

Somehow it includes negative prompt into image at low cfg. At 3 it has much weight, but at 4 seems to work as expected

Arctomachine avatar Mar 26 '24 22:03 Arctomachine

IIRC once CFG goes to 0 (or perhaps negative) the negative prompt essentially becomes the positive prompt. Could this be the case, that with the low value, whatever maths were undertaken brought the effective CFG down to/below 0?

Could just be wild speculation, if so, apologies for injecting noise (no pun intended).

worstpractice avatar Mar 27 '24 12:03 worstpractice

Somehow it includes negative prompt into image at low cfg. At 3 it has much weight, but at 4 seems to work as expected

I'm really not sure. Like, if you type "a kitten on a bike" in your negatives, do you actually obtain this? I'm curious. I assume that you're using the "Negative" node which allows to lerp the uncond?

Extraltodeus avatar Apr 15 '24 17:04 Extraltodeus

Not tried complex composition, but "(low quality:1.2)" in negative prompt attempts to put it into image as plain text.

Arctomachine avatar Apr 15 '24 18:04 Arctomachine

Using the negative node? Do you have a reproducible example? I don't mind downloading a model to try it out.

Extraltodeus avatar Apr 15 '24 21:04 Extraltodeus

I figured out. It only happens when using together with lcm lora. True for 1.5 models, not tried xl. Happens when checkbox on and off (as long as node is connected). Also speed bonus is not applied in this combination. So false alarm then? image

Arctomachine avatar Apr 17 '24 11:04 Arctomachine

This is very strange! I rewrote most of the code today. Try with the update! However I don't even get how you are getting any kind of result by setting the CFG at 2 on your sampler since my function makes things really bad with such scale. I haven't tried with the lcm lora though.

Extraltodeus avatar Apr 17 '24 15:04 Extraltodeus

LOL I get the same result indeed!

image

02080UI_00001_

Extraltodeus avatar Apr 17 '24 15:04 Extraltodeus

With a CFG set at 4 it stops as well as with the speed boost enabled it seems

Extraltodeus avatar Apr 17 '24 15:04 Extraltodeus

I'm closing the ticket since the nodes are not really made to be used at such low CFG and still have no clue. I'll keep this in a corner of my mind until I get some idea tho!

Extraltodeus avatar May 15 '24 18:05 Extraltodeus