Xingguang Wei

icon indicating a website link blog.weskwong.tech icon indicating an email [email protected]

icon company University of Science and Technology of China icon location China icon location Ph.D. student @ USTC | LLM, MLLM, MLsys

Results 3 comments of Xingguang Wei

[Bug] vllm deploy InternVL3_5-241B-A28B error

> same err here The error can be resolved by installing the specific version `vllm==0.10.1.1`.

[Bug] Potential bug in InternVL3 preprocessor causing one video frame to be dropped for multi-video inputs

Thank you very much for your suggestion. This bug has been fixed through this PR: https://github.com/huggingface/transformers/pull/41121

Cannot load huggingface internvl3.5 with flash_attn

This may be because you are using the [hf version weights](https://huggingface.co/OpenGVLab/InternVL3_5-8B-HF), which calls [`modeling_internvl.py`](https://github.com/huggingface/transformers/blob/main/src/transformers/models/internvl/modeling_internvl.py) from the `transformers` library. The function in the `transformers` library is maintained by the community and...