CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

Support sequence_bias when decoding

Open mc-marcocheng opened this issue 5 months ago • 0 comments

In huggingface transformers, there is a generate option called sequence_bias to increase/decrease the logits of user-specified sequence of tokens, using the SequenceBiasLogitsProcessor. Would be nice to have such generation option here as well.

mc-marcocheng avatar Feb 04 '24 14:02 mc-marcocheng