Wahab Kawafi
Wahab Kawafi
I have run into this error with ``` nvcr.io/nvidia/pytorch:24.12-py3: pytorch-triton 3.0.0+72734f086 torch 2.6.0a0+df5bbc09d1.nv24.12 torch_tensorrt 2.6.0a0 torchprofile 0.0.4 torchvision 0.20.0a0 vllm 0.8.5.post2.dev0+g3015d5634.d20250609 ``` Error: ``` File "/vllm/vllm/compilation/compiler_interface.py", line 272, in compile...
I fixed this by setting `VLLM_USE_V1=0`
Thanks for looking @Jokeren, Do you have any AMD dependencies installed? How can I edit `-DTRITON_BACKENDS_TUPLE="(nvidia,amd)"` and not install HIP? Let me know if there is a method for me...
So the tag `v0.4` works. Every other version since has failed for me. I've tested: * v0.4 * v1.0 * v1.1 * v1.1.1 * v1.1.2 * v2.0 * v2.1
Hello @peterbell10, thanks for your reply. Using a more modern G++ helped me get further in the build process. However, I was not able to continue the build since there...
Thanks both. We had a weird requirement for an older version of triton. We were able to install by manually building LLVM.