text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

[Feature] Suppress tokens during generation

Open lvwerra opened this issue 1 year ago • 6 comments

Similar to bad_words_ids in transformers it would be useful to be able to pass a set of tokens that are never sampled during generation.

lvwerra avatar Apr 13 '23 12:04 lvwerra

Hello @lvwerra @OlivierDehaene - is anyone working on this? I am interested in contributing this enhancement

alex-jw-brooks avatar May 15 '23 09:05 alex-jw-brooks

@alex-jw-brooks hi, do you have any progress in this?

soulseen avatar Nov 29 '23 08:11 soulseen

@lvwerra @OlivierDehaene pls take a look. thanks

soulseen avatar Dec 08 '23 12:12 soulseen

+1

sapountzis avatar Apr 05 '24 12:04 sapountzis

+1

andrewscrub avatar Apr 24 '24 15:04 andrewscrub

+1

meitalbensinai avatar Aug 07 '24 12:08 meitalbensinai