Lu Fang
Lu Fang
Let's try rebase and see if the tests can pass?
If it doesn't work, we probably need a force merge from Simon or Woosuk. :-)
Retrying the CI now.
Could you rebase again to the main, some tests should be fixed on main already.
Is this AMD build or Nvidia build?
https://github.com/vllm-project/vllm/pull/19009 may work around. python setup.py develop is needed by AMD, Nvidia should go with pip install -e . Will dig further to understand how to fix the issue appropriately.
I think cmake version is probably the reason. I reproduced the problem with 3.26, but good with 4.0.2. Probably some bug preventing the cmake adding abi3 suffix to the .so...
Okay, https://github.com/vllm-project/vllm/pull/19019 should be the right fix. cmake 3.26.0 should be buggy and not generating the abi suffix in the .so file name appropriately. Please use 3.26.1 or newer version.
The fix landed. @bailuan could you check if the issue is fixed or not. So we can close the issue.
Close, feel free to open if the issue is not resolved.