vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Support custom models

Open WoosukKwon opened this issue 2 years ago • 0 comments

We need to provide clean abstractions and interfaces so that users can easily plug in their custom models.

WoosukKwon avatar May 20 '23 22:05 WoosukKwon