nszheng

Results 1 comments of


                                            nszheng

[Bug]: qwen2-vl 7b, on vllm 0.8.1 & 0.8.2, sometimes (not deterministically but depends on data) I got: ValueError: Attempted to assign 702 = 702 multimodal tokens to 703 placeholders

Same issue with vllm==0.8.5. Has the bug been fixed?