LLaVA icon indicating copy to clipboard operation
LLaVA copied to clipboard

[Question] "Exception: Can't find testdev_balanced_questions.json" when evaluate gqa.

Open jiaxiangc opened this issue 1 year ago • 2 comments

Question

I modify the eval.py from https://gist.github.com/haotian-liu/db6eddc2a984b4cbcc8a7f26fd523187. But I get this error. How to solve it, thank you.

jiaxiangc avatar Nov 07 '23 14:11 jiaxiangc

have you solve it? i get this error too

wyxscir avatar Mar 26 '24 06:03 wyxscir

Hello!You can choose "Download Questions" from https://cs.stanford.edu/people/dorarad/gqa/download.html. The downloaded zip contains ’testdev_balanced_questions.json‘, and you can put it into './playground/data/eval/gqa/data'

Minato-Zackie avatar Apr 23 '24 11:04 Minato-Zackie