MaoSong2022

icon indicating a website link https://maosong2022.github.io icon indicating an email [email protected]

icon location Shanghai, China icon location Dive into multimodal large language models.

Results 3 issues of MaoSong2022

[Benchmark]: Support CharXiv Benchmark (#921)

2 comment

CharXiv benchmark is a visual question answer (VQA) that is specified on Chart domain. CharXiv consists of two splits (val, test) and two modes descriptive and reasoning, this PR completes...

WIP

fix(image_mcp.py): use consistant argument (#929)

2 comment

fix argument error in MMMU_Pro benchmark, close #929

[Benchmark] Add support for CharXiv benchmark

[OpenAI GPT-4.1](https://openai.com/index/gpt-4-1/) uses [CharXiv](https://charxiv.github.io/) benchmark to show its vision capability. I belive CharXiv benchmark should be supported by VLMEvalKit. I am working on supporting this benchmark, any suggestions are welcomed...