RealCompo icon indicating copy to clipboard operation
RealCompo copied to clipboard

Published 20 hours ago • verified publisher icon YangLing0818

Results of T2I-Compbench

Open AdventureStory opened this issue 11 months ago • 9 comments

Hello, I'm interested in your perfect work. And I evaluated your method on the T2I-Compbench. The results are far from what you showed in the paper. I wonder if something has gone wrong?

Here are the implementation details:

  1. First, I got the layout from GPT4.

  2. I evaluated it in the color_val.txt of T2I-Compbench, which contains 300 prompts. (using BLIP-vqa method and --np_num 8 by default)

  3. I only got. 39.84 attributes, but the result is 93 in your paper. image

Could you please offer the layout file you use for T2I-Compbench? Or could you please tell me if something is wrong?

AdventureStory avatar Mar 12 '24 11:03 AdventureStory