vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[ROCm] add support to ROCm 6.0 and MI300

Open hongxiayang opened this issue 1 year ago • 3 comments

This diff adds support to ROCm 6.0 and MI300

hongxiayang avatar Dec 26 '23 19:12 hongxiayang

Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.

WoosukKwon avatar Dec 26 '23 22:12 WoosukKwon

Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.

sure, will let you know. I am in the process updating the base image to ROCm 6.0

hongxiayang avatar Jan 05 '24 23:01 hongxiayang

Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.

@WoosukKwon It is ready for review now. Not sure why all the ci jobs (buildkite/ci/pr/pipeline and buildkite/ci/pr) failed.

hongxiayang avatar Jan 06 '24 00:01 hongxiayang