OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

Published 20 hours ago • verified publisher icon bentoml

feat: add vllm 0.3.0 support

Open whyiug opened this issue 1 year ago • 3 comments
trafficstars

Feature request

tag 0.3.0 is a big update, please support. https://github.com/vllm-project/vllm/releases/tag/v0.3.0

Motivation

No response

Other

No response

whyiug avatar Jan 31 '24 14:01 whyiug

Will work on it this week.

aarnphm avatar Jan 31 '24 20:01 aarnphm

Linked pull request https://github.com/bentoml/OpenLLM/pull/925

remkolems avatar Mar 13 '24 12:03 remkolems

This is the PR https://github.com/bentoml/OpenLLM/pull/821

aarnphm avatar Mar 13 '24 17:03 aarnphm