VL-BERT icon indicating copy to clipboard operation
VL-BERT copied to clipboard

Improper RefCOCO evaluation

Open st2yang opened this issue 3 years ago • 0 comments

When comparing MAttNet in Table 3, the target classification accuracy should be used. While computing IOU to approximate the classification accuracy, a small threshold (https://github.com/jackroos/VL-BERT/blob/master/refcoco/function/test.py#L17) was used, which could count false positive as correct.

st2yang avatar Jul 18 '21 19:07 st2yang