MAJOR BUG: Beam search does not work according to README

Open casper-hansen opened this issue 11 months ago • 1 comments

use_beam_search or length_penalty or best_of just triggers an error. Please fix this!

{"requestId": "...", "message": "Unexpected keyword argument 'use_beam_search'", "level": "ERROR"}

Jan 25 '25 16:01 casper-hansen

@casper-hansen Do you encounter this issue when using OpoenAI compat API?

Jan 28 '25 00:01 pandyamarut

Best of is deprecated in vllm (V1) https://github.com/vllm-project/vllm/issues/13361

May 31 '25 01:05 nerdylive123