OpenLLM
OpenLLM copied to clipboard
feat: add vllm 0.3.0 support
trafficstars
Feature request
tag 0.3.0 is a big update, please support. https://github.com/vllm-project/vllm/releases/tag/v0.3.0
Motivation
No response
Other
No response
Will work on it this week.
Linked pull request https://github.com/bentoml/OpenLLM/pull/925
This is the PR https://github.com/bentoml/OpenLLM/pull/821