VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard

[Benchmark] Add support for CharXiv benchmark

Open MaoSong2022 opened this issue 8 months ago • 0 comments

OpenAI GPT-4.1 uses CharXiv benchmark to show its vision capability. I belive CharXiv benchmark should be supported by VLMEvalKit.

I am working on supporting this benchmark, any suggestions are welcomed :)

  • [x] descriptive_val.tsv file
  • [x] reasoning_val.tsv file
  • [ ] test

MaoSong2022 avatar Apr 16 '25 02:04 MaoSong2022