MLLM-CompBench icon indicating copy to clipboard operation
MLLM-CompBench copied to clipboard

Published 8 months ago • verified publisher icon RaptorMai
→

Metadata

[NeurIPS'25] MLLM-CompBench evaluates the comparative reasoning of MLLMs with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, tem...

Results 2 MLLM-CompBench issues
Sort by recently updated
recently updated
newest added

Two datasets cannot be processed due to misssing files / non-existing dirs

Two datasets cannot be processed due to misssing files / non-existing dirs, as shown below: 1. cub_200_2011 ![0](https://github.com/user-attachments/assets/e0f5e620-afed-4bd4-afc4-ad3ac421c03b) ![1](https://github.com/user-attachments/assets/3a638ef9-cb81-477b-9232-4244b0bd6267) ![2](https://github.com/user-attachments/assets/6b7a69b3-17f1-4b5d-bd0d-30e9e9b94731) 2. soccernet (I have run "preprocessing/soccernet/download_soccernet.py" to download all the...

ZJU2021 avatar ZJU2021

Author Message

1 comment

To make data access easier, we provide processed data and updated annotations on both our project website and GitHub page. https://compbench.github.io/ https://github.com/RaptorMai/MLLM-CompBench Please open an issue if you have any...

RaptorMai avatar RaptorMai

← Metadata

41
Stars
2
Forks
41
Watchers

Owner

verified publisher icon RaptorMai

Metadata

[NeurIPS'25] MLLM-CompBench evaluates the comparative reasoning of MLLMs with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, tem...

Back