lorax icon indicating copy to clipboard operation
lorax copied to clipboard

Beam search support

Open mrcchef opened this issue 10 months ago • 1 comments

Feature request

Lorax should support various decoding strategies like Beam search.

Motivation

It would be invaluable when the user wants to generate multiple responses and at the same time ensure that they are diverse to each other and the best possible generation as well based on the model's training

Your contribution

.

mrcchef avatar Feb 03 '25 06:02 mrcchef

Yeahh! I think beam Search support would be a great addition to Lorax. During, inference it would help generate more diverse and high-quality responses.

MrStrange124 avatar Feb 06 '25 11:02 MrStrange124