Unable to perform VLLM offline inference.

Open yujunhuics opened this issue 4 months ago • 2 comments

ERROR:

File "xxxx/lib/python3.10/site-packages/vllm/multimodal/processing.py", line 1652, in _apply_prompt_updates assert update_idx is not None, ( AssertionError: Failed to apply prompt replacement for mm_items['image'][0] ERROR 09-09 03:01:31 [core_client.py:562] Engine core proc EngineCore_0 died unexpectedly, shutting down client.

Sep 09 '25 10:09 yujunhuics

请问这个有解决方案吗

Sep 15 '25 08:09 lTloser

I came across the same issue too! Is there any solution for this?

Sep 28 '25 11:09 Artessay