Jacob0226

Results 3 comments of Jacob0226

Same here. OS: Ubuntu 22.04.5 LTS ROCm: 6.3.1 ![Image](https://github.com/user-attachments/assets/3cbfe982-22fb-4086-8f03-17e4efb240d9)

hello, I met with simiar issue. The images nvcr.io/nvidia/pytorch:24.12-py3 and nvcr.io/nvidia/pytorch:25.01-py3 doesn't work with vllm 0.7.2, right?

@kkimmk This works for me on vllm 0.7.3 and should work with 0.7.2: ``` image: nvcr.io/nvidia/pytorch:25.01-py3 pip install vllm==0.7.3 datasets pip install --upgrade flash-attn ```