text icon indicating copy to clipboard operation
text copied to clipboard

BLEU_SCORE weird behaviour

Open qlemesle opened this issue 1 year ago • 0 comments

❓ Questions and Help

Is it normal that with standard bleu settings if an n_gram isn't in references then the score returned is 0 ?

With default settings (4 n_grams and weights = [0.025] *4) The candidate : ['Le', 'petit', 'chat', 'moche'] For the reference : ['Le', 'petit', 'chat', 'mignon'] Get a bleu score of 0.

Due to this line in the code : if min(clipped_counts) == 0: return 0.0

Is this behaviour normal ?

qlemesle avatar Jan 25 '24 13:01 qlemesle