Zaid Khan

I think #2406 is related. [Here](https://github.com/vllm-project/vllm/blob/87f545ba6fdbbbe9813736fc398874563e2604a7/vllm/executor/ray_gpu_executor.py#L121) is a permalink to the place where the error is raised. Whatever is going wrong happens here: ```python if worker_ip == driver_ip and self.driver_dummy_worker...

@nkwangleiGIT thanks for the tip! I was able to use it for a solution. @sam-h-bean I think I figured out what's going wrong and how to fix it. In my...

@rkooo567 I wasn't able to get this to work on earlier versions, so I don't think it has ever worked (but I could be wrong).

Hi @YuanLiuuuuuu, this comment describes how they were able to reproduce the BLIP-2 OPT results. I haven't tried it yet: https://github.com/salesforce/LAVIS/issues/188