EnergonAI icon indicating copy to clipboard operation
EnergonAI copied to clipboard

num_beams for beam search

Open shammmmmless opened this issue 2 years ago • 1 comments

Hi, I want to use num_beams for generate, but PipelineModel can't. Can you support num_beams?

Best wishes.

shammmmmless avatar Aug 30 '22 07:08 shammmmmless

Since we are working on imporving a large-scale model demo recently, the requirement might be delayed for one or two weeks. You can use beam search in transformer and add it to your code following this. Also, welcome you to contribute your beam code usage to the project.

dujiangsu avatar Sep 01 '22 13:09 dujiangsu