DeCo icon indicating copy to clipboard operation
DeCo copied to clipboard
verified publisher icon yaolinli

How evaluate RefCOCO?

Open liuting20 opened this issue 11 months ago • 3 comments

LLaVA can't support visual grounding, how can you perform inference on RefCOCO?

liuting20 avatar Jan 14 '25 04:01 liuting20

We reference the evaluation code from Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models.

yaolinli avatar Jan 14 '25 05:01 yaolinli

Can you specify which part of the code it is? @yaolinli

Volta-lemon avatar Feb 15 '25 02:02 Volta-lemon

now，do you have any recommended evaluation code？ @liuting20

Volta-lemon avatar Feb 15 '25 02:02 Volta-lemon

Hi, the lmm-evals repo has supported refcoco evaluation.

yaolinli avatar Jul 13 '25 09:07 yaolinli