DALLE2-pytorch icon indicating copy to clipboard operation
DALLE2-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Classifier-Free Guidance Formulation

Open MoayedHajiAli opened this issue 1 year ago • 3 comments

In the classifier-free guidance paper, the formulation is as follow image

However, it is implemented in DALL-2 as null_logits + (logits - null_logits) * cond_scale According to the formula it should be logits + (logits - null_logits) * cond_scale where the logits are the conditional score and null_logits are the unconditional ones.

Can you please clarify the reason for this modification? Thank you!

MoayedHajiAli avatar Sep 18 '23 05:09 MoayedHajiAli

@MoayedHajiAli Have you found the reason? I'm also wondering why

nshidqi avatar Dec 13 '23 07:12 nshidqi

@nshidqi @MoayedHajiAli I also have the same question. May I ask if you have found the reason now?

tengteng95 avatar Jan 19 '24 09:01 tengteng95

Hi @tengteng95. I couldn't find the reason

MoayedHajiAli avatar Jan 19 '24 17:01 MoayedHajiAli