OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

Published 20 hours ago • verified publisher icon bentoml

feat: any plan to support NPU

Open zhangxinyang97 opened this issue 1 year ago • 1 comments

Feature request

support Ascend NPU

Motivation

more and more developer using NPU, and vllm is also interesting in NPU ecosystem, https://github.com/vllm-project/vllm/issues/1606.

Other

No response

zhangxinyang97 avatar Apr 13 '24 03:04 zhangxinyang97

we don't have any immediate plan atm.

aarnphm avatar May 30 '24 19:05 aarnphm