Junhui Yu

Unable to perform VLLM offline inference.

2

ERROR: File "xxxx/lib/python3.10/site-packages/vllm/multimodal/processing.py", line 1652, in _apply_prompt_updates assert update_idx is not None, ( AssertionError: Failed to apply prompt replacement for mm_items['image'][0] ERROR 09-09 03:01:31 [core_client.py:562] Engine core proc EngineCore_0 died...