bruceisme

[Question] TextVQA’s OCR

1

### Question In ./playground/data/eval/textvqa/llava_textvqa_val_v051_ocr.jsonl, the "text" part of each piece of data contains the **Reference OCR token** content. May I ask where this part of OCR is obtained from?

"IndexError: list index out of range" on multiple GPU

2

Hi, when I try to run evaluate_vqa_beam.sh to generate test_dev's answers on multiple GPU, there always occurs error. File "OFA/data/mm_data/vqa_gen_dataset.py", line 149, in __getitem__ item = self.dataset[index] File "OFA/data/file_dataset.py", line...

Use of ocr in Evaluation

1

In Appendix A's Image-text Data Collection, mention "_It is important to note that the OCR detector is utilized solely for generating enriched data and is not employed during testing_ "....