LAVIS icon indicating copy to clipboard operation
LAVIS copied to clipboard

[BLIP2]: Low accuracy of zeroshot VQA of BLIP2-opt-2.7b

Open YuanLiuuuuuu opened this issue 1 year ago • 12 comments

Hi,

Thank you for your great work BLIP2. I find there is no zeroshot VQA evaluation code for BLIP2-OPT, so I create one, refering to the code of FLAN-T5. However, the accuracy is very low. I will be very grateful if you can provide the code for BLIP2-OPT VQA zeroshot. Thanks in advance!

image

YuanLiuuuuuu avatar Apr 07 '23 02:04 YuanLiuuuuuu