zero-shot-pose icon indicating copy to clipboard operation
zero-shot-pose copied to clipboard

Published 20 hours ago • verified publisher icon applied-ai-lab

How to deal with CO3D's broken labels

Open AlbertoRemus opened this issue 1 year ago • 1 comments

Hello !

I wanted to ask how the method deals (also for evaluation metrics) broken masks that are often present in the CO3D dataset

Screenshot from 2024-01-24 17-59-39

Thanks in advance,

Alberto

AlbertoRemus avatar Jan 24 '24 17:01 AlbertoRemus

By running the evalutation is possible to notice that in some case there are some target images unrelated to the target object, just consider these examples, how is this considered when assessing the metrics?

6th target image is wrong Screenshot from 2024-01-24 22-05-48

first target image is wrong Screenshot from 2024-01-24 22-13-07

AlbertoRemus avatar Jan 24 '24 21:01 AlbertoRemus