ADAPET icon indicating copy to clipboard operation
ADAPET copied to clipboard

Confusion regarding equations (5) and (6)

Open Kiwifed0r opened this issue 1 year ago • 0 comments

Hi!

I have a question regarding equations (5) and (6). If I understand it correctly, both cases, i.e., cross entropy and binary cross entropy, use the same probability distribution $q(y|x)$. And the two equations are equivalent and result in the same loss. Is that correct?

In all my tests, I get the same value for the left part of both equations. But I'm confused how the right parts are equivalent.

Kiwifed0r avatar Jul 18 '23 10:07 Kiwifed0r