Xinyu Fang

I also encounter this error message: java.lang.AssertionError: Unexpected nvidia-smi response. But my docker image don't have gpu at all, so it's normal that running nvidia-smi returns nothing. How can I...

Hi @nutsintheshell. I'd like to know your execution command, and I'll try to reproduce it. By the way, we do not provide all dataset results in VLMEvalKit, you can refer...

Hi @The-Git-Rain. For Qwen2VL, we recommend that you use transformers>=4.48.0 For mPLUG-Owl3, it seems to be the same problem as Qwen2vl. You can also try to upgrade the transformers

hi @helloworld01001. transformers版本请参照Qwen-VL-2官方设定 `pip install git+https://github.com/huggingface/transformers@21fac7abba2a37fae86106f87fcf9974fd1e3830 accelerate` 你测试时显示的这一问题可能是transformers版本不对应导致的，我测试时暂未遇见该报错。

> Sorry, I don't have an answer to your question, but I'm trying to run the same example script on Qwen 2.5 VL 3B, and I keep getting the following...

Hi @droidXrobot @shan23chen! This repo now supports Llama-3.2-11B/90B-Vision-Instruct, you can use it with the newest transformers version (>=4.45.0.dev0)! However, the evaluation results obtained based on the current repo do not...

Hello @davidluciolu , this setting can be configured for the incoming text/images when passing messages, please refer to to https://github.com/InternLM/lmdeploy/blob/main/docs/en/multi_modal/qwen2_5_vl.md#offline-inference for detailed solution.

Hi @mary-0830, For TableVQABench, as of now VLMEvalKit only supports evaluating MLLMs, and the output modal only supports Vision, the specific four values that correspond to the four values of...

Please refer to the official Qwen-VL-2 settings for the transformers version. `pip install git+https://github.com/huggingface/transformers@21fac7abba2a37fae86106f87fcf9974fd1e3830 accelerate` The problem you're seeing in your tests may be caused by a mismatch in the...

Hi @Orlando-CS. Thank you for your support of our community. You can add models to VLMEvalKit by submitting a pull request. You can refer to this pull request: https://github.com/open-compass/VLMEvalKit/pull/697. If...