Pengyun Lin
Pengyun Lin
HI, I think this is mentioned in #273, you can refer to that PR and see the progress.
> Hello, the question seems to remain unsolved. When I set max_num_batched_tokens very big (such as 10000) or the length of input tokens is quite long (near 10000), vLLM will...
/bot kill