WHL

zero-shot accuracy of instructblip on ScienceQA

2

Thank you for your outstanding work. 1. I noticed that the paper mentions "For ScienceQA, we only evaluate the set with image context." Does this mean that the hint or...

``` from lavis.datasets.builders import load_dataset dataset = load_dataset("gqa") ``` ValueError: unknown url type: '/export/share/datasets/vision/GQA/questions1.2/train_all_questions/train_all_questions_0.json'

I had some trouble reproducing InstructBlip model results on the msvd_qa and msrvtt_qa datasets. Could you please tell me what prompt template and hyperparameters were used for these datasets ?...