Xiangyu Zhao

Results 44 comments of Xiangyu Zhao

Hi, Thank you for your interest in VLMEvalKit! Please note that **MMBench_V11.tsv** is not publicly available. If you'd like to evaluate **MMBenchV11_TEST_EN**, you can use the following command: ```bash python...

Thank you for taking the time to share your suggestion. We’ve addressed the issue in [PR 1294](https://github.com/open-compass/VLMEvalKit/pull/1229). Now use `SPLIT_THINK=True` and `PRED_FORMAT=tsv` will lead to correct results.

> Hi [@PhoenixZ810](https://github.com/PhoenixZ810), > > I’m still experiencing the repetition issue with the InternVL3.5 models in thinking mode, even after updating to the latest commit ([cfa63b1](https://github.com/open-compass/VLMEvalKit/commit/cfa63b1df9d861313cc444af676488b6f1445222)). > > Here’s the...

Thank you for taking the time to share your suggestion. We’ve addressed the issue in [PR1229](https://github.com/open-compass/VLMEvalKit/pull/1229).