close icon indicating copy to clipboard operation
close copied to clipboard

vqa_score divided by 3

Open Flaick opened this issue 5 months ago • 0 comments

Hello, thank you for the interesting work. Though I have a question about the vqa score calculation. When I run the eval.py to calculate the evaluation scores for vqa, I find the min(normlized_answers.get(vqa_preprocess(answer), 0) / 3, 1) is used to calculate the score (accuracy?). However, I am confused by the /3 here. Can you explain this to me thanks! def vqa_score(answer, ground_truth_answer_counts) in evaluator.py

Flaick avatar Jan 23 '24 12:01 Flaick