plug-and-blend icon indicating copy to clipboard operation
plug-and-blend copied to clipboard

Is it possible to apply GeDi to encoder-decoder models?

Open 20174376 opened this issue 2 years ago • 1 comments

Is it possible to apply GeDi to encoder-decoder models? Like T5 or BART?

20174376 avatar Aug 26 '22 02:08 20174376

Sorry for the late reply! If these models get their next token by softmax-ing over a distribution of candidate tokens (which I believe they do), you should be able to apply GeDi and plug-and-blend to them.

xxbidiao avatar Oct 23 '22 16:10 xxbidiao