vllm icon indicating copy to clipboard operation
vllm copied to clipboard
Published 2 weeks ago • verified publisher icon vllm-project

add policy

Open xxw1995 opened this issue 2 years ago • 2 comments

xxw1995 avatar Dec 13 '23 00:12 xxw1995

Hi @xxw1995, could you elaborate more on this PR (e.g., what it is for and how much performance gain you got)?

WoosukKwon avatar Jan 03 '24 05:01 WoosukKwon

Hi @xxw1995, could you elaborate more on this PR (e.g., what it is for and how much performance gain you got)?

In our business, we achieved approximately a 15% performance gain.

xxw1995 avatar Jan 03 '24 06:01 xxw1995