sglang icon indicating copy to clipboard operation
sglang copied to clipboard
Published 1 month ago • verified publisher icon sgl-project

[Feature Request] Returning more logprobs

Open brucethemoose opened this issue 1 year ago • 1 comments

Could we get the ability to return more than one logprob per token, akin to vllm or openai?

brucethemoose avatar Mar 14 '24 02:03 brucethemoose

This is on my TODO list for a while but I haven't got a chance to work on it. If anyone wants to contribute a PR before I do, I'll be happy to review.

comaniac avatar Mar 14 '24 04:03 comaniac

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Jul 25 '24 06:07 github-actions[bot]