vib icon indicating copy to clipboard operation
vib copied to clipboard

Question regarding loss function.

Open WeiQin-C opened this issue 3 years ago • 0 comments

Hi, thank you so much for the awesome tutorial. I have a quick question regarding the loss for the second term of Information bottleneck I(Z, X).

Given I(Z, X) = KL[p(z|x), q(z)], how does it become 0.5 * (mu^2 + std^2 - 2*log(std) - 1)?

Thank you. I apologize for the stupid question as I am not very familiar with the underlying maths.

WeiQin-C avatar Aug 08 '21 22:08 WeiQin-C