floe20 comments

Repositories
Issues
Comments

Results 1 comments of


                                            floe20

💡 [REQUEST] - Is there any guidance on how to reproduce the benchmark results?

Hi, please refer to the section about minicpm-o in the VLMEvalKit toolkit ([vlmeval/vlm/minicpm_v.py](https://github.com/open-compass/VLMEvalKit/blob/main/vlmeval/vlm/minicpm_v.py#L539)). For most benchmarks, such as those in the OpenCompass leaderboard, we provide standard evaluation settings that you...