CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Feature request: Word level scores

Open ItakeLs opened this issue 1 year ago • 11 comments

Hi, currently the decoder produces sentence level scores, instead of just outputting the average another option would be produce the score of each word/token.

Beam search might be a harder task to calculate a meaningful individual score, but for greedy I am assuming its just a matter of not averaging the scores together, please correct me if I'm wrong.

ItakeLs avatar Feb 12 '23 18:02 ItakeLs