vllm
vllm copied to clipboard
[ROCm] add support to ROCm 6.0 and MI300
This diff adds support to ROCm 6.0 and MI300
Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.
Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.
sure, will let you know. I am in the process updating the base image to ROCm 6.0
Hi @hongxiayang, thanks for submitting this PR! Please let us know when the PR is ready for review.
@WoosukKwon It is ready for review now. Not sure why all the ci jobs (buildkite/ci/pr/pipeline and buildkite/ci/pr) failed.