Why is the cross entropy calculated by marian-scorer negative？

[zhangxinlu16]

When I use marian-scorer to calculate cross-entropy for each sentence pair, why i get negative score for each sentence pair cross entropy?

[kpu]

log

[zhangxinlu16]

log

According to the definition of cross entropy, the result should be non-negative. Is marian-scorer's result a negative cross entropy?

[emjotde]

Hi, The per-sentence score is just a sum of log probabilities, so technically a negative cross-entropy. Taking exp(score) you would get the total sentence probability in normal probability space between 0 and 1.

[zhangxinlu16]

Hi, The per-sentence score is just a sum of log probabilities, so technically a negative cross-entropy. Taking exp(score) you would get the total sentence probability in normal probability space between 0 and 1.

Thanks for your reply!