DALL-E icon indicating copy to clipboard operation
DALL-E copied to clipboard

How to derive the Equation 1?

Open AaronHeee opened this issue 2 years ago • 4 comments

Sorry I have to re-open an issue as the same as #20, where I posted my attempt to derive the equation 1 but cannot get the result. Could you let me know what I miss? Thanks!

AaronHeee avatar Jun 12 '22 19:06 AaronHeee

Hi,I've tried to derive the equation 1, and get the same result as yours in https://github.com/openai/DALL-E/issues/20. Have you figured it out? Looking forward to your reply, thanks very much!

geweihgg avatar Sep 14 '22 10:09 geweihgg

i have tried to derive the equation (1) using KL divergence between q(z|x) and p(z|x,y), which also does not work. hope the authors could give a clear and complete derive

YUYUEinFDU avatar Oct 20 '22 12:10 YUYUEinFDU

Hey folks- I was also confused by this, so I wrote up the derivation. I'd appreciate a second check over my math.

finbarrtimbers avatar Apr 05 '23 17:04 finbarrtimbers

I have been looking into this equation for sometime. I wrote my thoughts in the attached main.pdf. I believe we need to convert a single-variable distribution $q_{\phi}(z|x)$ into a multi-variable distribution $q_{\phi}(y,z|x)$ to derive this equation. Yet, I am not sure if I made the right assumptions. I hope someone look into my derivation and share some feedback.

ahmdtaha avatar Jan 01 '24 19:01 ahmdtaha