dave

ARM aarch-64 server build failed (host OS: Ubuntu22.04.3)

20

do as: https://docs.vllm.ai/en/latest/getting_started/installation.html 1. docker run --gpus all -it --rm --ipc=host nvcr.io/nvidia/pytorch:23.10-py3 2. git clone https://github.com/vllm-project/vllm.git 3. cd vllm 4. pip install -e . here is the details in side...