vllm [Bug]: After updating to vllm 0.5.3.post1, "Exception in worker VllmWorkerProcess while processing method init_device: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method."

[Bug]: After updating to vllm 0.5.3.post1, "Exception in worker VllmWorkerProcess while processing method init_device: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method."

Open Jerry-jwz opened this issue 6 months ago • 5 comments

Same as in issue #7077.

I met the same problem as in issue #7077, but the issue was closed without solutions. I would like to raise this issue again and seek for kind help.

Aug 05 '24 08:08 Jerry-jwz