MiniCPM-V icon indicating copy to clipboard operation
MiniCPM-V copied to clipboard

💡 [REQUEST] - Is there any guidance on how to reproduce the benchmark results?

Open lirongxu-g opened this issue 9 months ago • 1 comments

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

Is there any guidance on how to reproduce the benchmark results?

基本示例 | Basic Example

for example, some python script

缺陷 | Drawbacks

none

未解决问题 | Unresolved questions

No response

lirongxu-g avatar Mar 20 '25 11:03 lirongxu-g

Hi, please refer to the section about minicpm-o in the VLMEvalKit toolkit (vlmeval/vlm/minicpm_v.py). For most benchmarks, such as those in the OpenCompass leaderboard, we provide standard evaluation settings that you could follow.

floe20 avatar Jun 16 '25 03:06 floe20