phoenixysj

Is beam search strategy mandatory in gptj-6b benchmark?

1

hi, I found that vllm will drop beam search feature in future releases due to complicated implementation and beam search is not so popular in real use. So could I...