vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Published 20 hours ago • verified publisher icon vllm-project

[Feature]: AMD ROCm 6.1 Support

Open kannan-scalers-ai opened this issue 1 year ago • 1 comments

🚀 The feature, motivation and pitch

AMD ROCm 6.1 has been released with significant performance improvements for AMD GPUs, including the MI300X.. When can we expect support for ROCm 6.1 on vLLM?

Alternatives

No response

Additional context

No response

kannan-scalers-ai avatar Apr 17 '24 15:04 kannan-scalers-ai

Have you tried building for 6.1? What results do you get?

gardner avatar May 05 '24 01:05 gardner

@kannan-scalers-ai ROCm 6.1 is supported in the current main branch now. Please check and close this issue.

hongxiayang avatar Jul 12 '24 19:07 hongxiayang

@hongxiayang thanks for the update.

kannan-scalers-ai avatar Jul 15 '24 04:07 kannan-scalers-ai