vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Installation]: error: can't copy 'build/lib.linux-x86_64-cpython-310/vllm/_C.abi3.so': doesn't exist or not a regular file

Open bailuan opened this issue 6 months ago • 2 comments

Your current environment

python 3.10.13 torch2.6 gcc 12.3.0

How you are installing vllm

When I install from source, encounter a this error: error: can't copy 'build/lib.linux-x86_64-cpython-310/vllm/_C.abi3.so': doesn't exist or not a regular file. I can't find useful answer in issue base.

Before submitting a new issue...

  • [x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

bailuan avatar May 27 '25 06:05 bailuan

I use python setuo.py develop.

bailuan avatar May 27 '25 06:05 bailuan

try: pip install -e .

jeejeelee avatar May 27 '25 08:05 jeejeelee

Is this AMD build or Nvidia build?

houseroad avatar Jun 01 '25 14:06 houseroad

https://github.com/vllm-project/vllm/pull/19009 may work around. python setup.py develop is needed by AMD, Nvidia should go with pip install -e .

Will dig further to understand how to fix the issue appropriately.

houseroad avatar Jun 02 '25 02:06 houseroad

I think cmake version is probably the reason. I reproduced the problem with 3.26, but good with 4.0.2. Probably some bug preventing the cmake adding abi3 suffix to the .so file.

houseroad avatar Jun 02 '25 08:06 houseroad

Okay, https://github.com/vllm-project/vllm/pull/19019 should be the right fix. cmake 3.26.0 should be buggy and not generating the abi suffix in the .so file name appropriately. Please use 3.26.1 or newer version.

houseroad avatar Jun 02 '25 11:06 houseroad

The fix landed. @bailuan could you check if the issue is fixed or not. So we can close the issue.

houseroad avatar Jun 03 '25 08:06 houseroad

Close, feel free to open if the issue is not resolved.

houseroad avatar Jun 05 '25 04:06 houseroad