Jisheng Yin

you should go to bricks.py. You can find a class named 'Bricks'. and you should add a default number 0 for brick_type.

socre 0 for GPT4o_20241120 model on CCOCR_DocParsing_TablePhotoEng

3

I test gpt4o_20241120 on CCOCR_DocParsing_TablePhotoEng. However, I find the score seems to be 0. Here is an example: gt: \n \n \n \n code\n \n \n left side label\n \n...

different score when evaluation

1

I use the official code for evaluation. I evaluate gpt-4o-mini-2024-07-18. the scores is 35.8 on reasoning, which is a little difference comparing to the leaderboard. What's more, I test gpt-4o-2024-05-13...

I try to evaluate models on HallusionBench. The number of hallusionbench in lmevalkit is 951, which is 1129 in HallusionBench's huggingface. I wonder why they have different number. What's more,...