[Installation]: error: can't copy 'build/lib.linux-x86_64-3.10/vllm/_core_C.abi3.so': doesn't exist or not a regular file

[DreamerZhang11]

Your current environment

The output of `python collect_env.py`

Collecting environment information... PyTorch version: 2.4.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.4 LTS (x86_64) GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 Clang version: Could not collect CMake version: version 3.26.0 Libc version: glibc-2.35

Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] (64-bit runtime) Python platform: Linux-5.15.0-102-generic-x86_64-with-glibc2.35 Is CUDA available: True CUDA runtime version: 12.5.40 CUDA_MODULE_LOADING set to: LAZY GPU models and configuration: GPU 0: NVIDIA GeForce RTX 4090 D Nvidia driver version: 555.58.02 cuDNN version: Could not collect HIP runtime version: N/A MIOpen runtime version: N/A Is XNNPACK available: True

Versions of relevant libraries: [pip3] numpy==1.26.4 [pip3] nvidia-cublas-cu12==12.1.3.1 [pip3] nvidia-cuda-cupti-cu12==12.1.105 [pip3] nvidia-cuda-nvrtc-cu12==12.1.105 [pip3] nvidia-cuda-runtime-cu12==12.1.105 [pip3] nvidia-cudnn-cu12==9.1.0.70 [pip3] nvidia-cufft-cu12==11.0.2.54 [pip3] nvidia-curand-cu12==10.3.2.106 [pip3] nvidia-cusolver-cu12==11.4.5.107 [pip3] nvidia-cusparse-cu12==12.1.0.106 [pip3] nvidia-ml-py==12.560.30 [pip3] nvidia-nccl-cu12==2.20.5 [pip3] nvidia-nvjitlink-cu12==12.6.68 [pip3] nvidia-nvtx-cu12==12.1.105 [pip3] optree==0.12.1 [pip3] pyzmq==26.2.0 [pip3] torch==2.4.0 [pip3] torchvision==0.19.0 [pip3] transformers==4.44.2 [pip3] triton==3.0.0 [conda] Could not collect ROCM Version: Could not collect Neuron SDK Version: N/A vLLM Version: N/A vLLM Build Flags: CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled

How you are installing vllm

pip install -vvv vllm

when i use "python setup.py develop" to build vllm, (pip install -e . don't work even half a hour) when finnal link the error is happen, "error: can't copy 'build/lib.linux-x86_64-3.10/vllm/_core_C.abi3.so': doesn't exist or not a regular file". So, i googled and also know why happen this ？

Before submitting a new issue...

• [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[jeejeelee]

pip install -e . don't work even half a hour

Use pip install -vvv -e . to display the build details, the likely cause could be related to compiling C code

[youcanyouupsb]

我遇到了同样的问题，但是我的环境是amd卡的rocm环境，找不到的库并不是没有，只是不在对应目录中,而是在vllm目录中，我尝试拷贝过去，就ok了

[HollowMan6]

I encountered this when I installed vLLM via python setup.py develop, and I could fix this by deleting the build folder, so I guess that it's related to the incorrect build cache.

[shaoyuyoung]

I have encountered the same issue when I follow the instructions here (https://docs.vllm.ai/en/latest/getting_started/installation.html#use-an-existing-pytorch-installation) Is there any solutions?

[solinzby1]

I encountered the same issue when use python setup.py develop to build vllm. I update python version and gcc version to fix this issue .(torch2.4.0+python3.12 + gcc 12)

[shaoyuyoung]

I encountered the same issue when use python setup.py develop to build vllm. I update python version and gcc version to fix this issue .(torch2.4.0+python3.12 + gcc 12)

Actually, I can't install vllm with torch 2.6 (nightly version) :(

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

[github-actions[bot]]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant. Thank you!

[houseroad]

The root cause is actually cmake 3.26.0, upgrading to 3.26.1 or newer version should solve the problem.

[houseroad]

Same as https://github.com/vllm-project/vllm/issues/18748