Jacob0226
Jacob0226
Same here. OS: Ubuntu 22.04.5 LTS ROCm: 6.3.1 
hello, I met with simiar issue. The images nvcr.io/nvidia/pytorch:24.12-py3 and nvcr.io/nvidia/pytorch:25.01-py3 doesn't work with vllm 0.7.2, right?
@kkimmk This works for me on vllm 0.7.3 and should work with 0.7.2: ``` image: nvcr.io/nvidia/pytorch:25.01-py3 pip install vllm==0.7.3 datasets pip install --upgrade flash-attn ```