vib
vib copied to clipboard
Question regarding loss function.
Hi, thank you so much for the awesome tutorial. I have a quick question regarding the loss for the second term of Information bottleneck I(Z, X).
Given I(Z, X) = KL[p(z|x), q(z)], how does it become 0.5 * (mu^2 + std^2 - 2*log(std) - 1)?
Thank you. I apologize for the stupid question as I am not very familiar with the underlying maths.