[Feature] Does sglang now support beam search

[StevenZHB]

Motivation

Does sglang now support beam search? I tried using the 'best_of' parameter, but the output seems to be the same as if it wasn't used.

Related resources

No response

[zhyncs]

Currently not supported. Whether to support it in the future needs to be discussed. At present, other features and optimizations may have a higher priority. Thank you for your interest in SGLang. Please stay tuned, thanks.

[min-xu-et]

I agree it is a low priority. There are a lot of way to generate diverse output from LLMs and then select a good response. Unclear that beam search is a good approach anyway.

[github-actions[bot]]

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.