text
text copied to clipboard
BLEU_SCORE weird behaviour
❓ Questions and Help
Is it normal that with standard bleu settings if an n_gram isn't in references then the score returned is 0 ?
With default settings (4 n_grams and weights = [0.025] *4) The candidate : ['Le', 'petit', 'chat', 'moche'] For the reference : ['Le', 'petit', 'chat', 'mignon'] Get a bleu score of 0.
Due to this line in the code : if min(clipped_counts) == 0: return 0.0
Is this behaviour normal ?