vllm
vllm copied to clipboard
[Installation]: poetry add vllm not working on my Mac -- xformers (0.0.26.post1) not supporting PEP 517 builds.
Your current environment
The output of `python collect_env.py`
How you are installing vllm
poetry add vllm
Can someone tell me what versions of ray and torch are compatible to add vlllm via poetry?
- Installing vllm-flash-attn (2.5.9): Failed
- Unable to find installation candidates for ray (2.24.0)
Note: This error originates from the build backend, and is likely not a problem with poetry but with xformers (0.0.26.post1) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "xformers (==0.0.26.post1)"'