sglang
sglang copied to clipboard
[Feature Request] Returning more logprobs
Could we get the ability to return more than one logprob per token, akin to vllm or openai?
This is on my TODO list for a while but I haven't got a chance to work on it. If anyone wants to contribute a PR before I do, I'll be happy to review.
This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.