InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

How to evaluate InternVL-Chat-V1-5 on video benchmark

Open royzhang12 opened this issue 1 year ago • 1 comments

Hi @czczup,

Thanks for open-sourcing such a wonderful job. The amazing performance on video task is surprising. Just a quesiton about how to evaluate the intervl-chat-v1-5 on video benchmark such as MVBench, Seed-Video. As I can not find scripts of video evaluation in the repo, would you mind to provide a script or give me some hint, such as how many patch one frame you used for evaluation and how to combine multi-frames(for instance, seperate each frame with <im_strat><im_end> or not ) ?

royzhang12 avatar Jun 28 '24 06:06 royzhang12

Hello! I recommend using vlmevalkit for testing video datasets, as it has already integrated InternVL series models and supports Video-MME and MMBench-Video.

czczup avatar Aug 06 '24 05:08 czczup