SplendidYuan
Results
3
comments of
SplendidYuan
### Should I extract all the files from MLVU_dev/video_part_1.zip to video_part_8.zip into the same folder?
I used lmms-eval to evaluate the models [LLaVA_OneVision-qwen2-7b-ov](https://github.com/LLaVA-VL/LLaVA-NeXT/blob/main/docs/LLaVA_OneVision.md) and [LLaVA-Video-7B-Qwen2](https://github.com/LLaVA-VL/LLaVA-NeXT/blob/main/docs/LLaVA_Video_1003.md) on MLVU_dev, but the results were **1% to 4% lower** than those reported in the original [paper](https://arxiv.org/abs/2410.02713). What could be...