Feature request: generate top k sequences

[yzhang-github-pub]

Instead of generate the best (top 1) sequence from autoregressive generate function, it is useful to generate >1 best sequences. For example, in language translation, human users can have choices from more than 1 best translations.

Thanks for your consideration.

[lucidrains]

@yzhang-github-pub do you mean beam search?

[yzhang-github-pub]

@lucidrains Not exactly. Using language translation as an example. The model generates one best target sentence, either greedily or by beam search. What I ask is to generate top k target sentences.