machine-learning-book
machine-learning-book copied to clipboard
KL divergence formula for discrete distributions (page 626)
Hi Sebastian,
There are 2 formulas of KL divergence for discrete distributions on the page 626, and it seems the second formula has missing log transformation for the second multiplier (instead of P(x)/Q(x) it must be equal to log(P(x) / Q(x)).
Thank you.