vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Published 20 hours ago • verified publisher icon vllm-project

[Core] BatchLLM for better shared prefix utilizing in offline scenarios

Open xinji1 opened this issue 1 month ago • 6 comments

Please take a look at the RFC Batchllm for more details.

cc @WoosukKwon @comaniac for the next step.

xinji1 avatar Feb 01 '25 05:02 xinji1