CTranslate2
CTranslate2 copied to clipboard
Feature request: Word level scores
Hi, currently the decoder produces sentence level scores, instead of just outputting the average another option would be produce the score of each word/token.
Beam search might be a harder task to calculate a meaningful individual score, but for greedy I am assuming its just a matter of not averaging the scores together, please correct me if I'm wrong.