lorax
lorax copied to clipboard
Beam search support
Feature request
Lorax should support various decoding strategies like Beam search.
Motivation
It would be invaluable when the user wants to generate multiple responses and at the same time ensure that they are diverse to each other and the best possible generation as well based on the model's training
Your contribution
.
Yeahh! I think beam Search support would be a great addition to Lorax. During, inference it would help generate more diverse and high-quality responses.