MuPots Evaluation

[nicolasugrinovic]

Hi, I have a question regarding MuPots annotations. I know you did not create the dataset. However, I see that annotations for some people in the images are missing. For example, for TS1/img_0000001.jpg, the image has 3 people, but annotations for 2d and 3d_kpts come only for 2 people.

Have you came with this problem while evaluating your method?

Thanks

[mks0601]

I checked that the evaluation is only performed for the annotated persons. As the evaluation metric is 3DPCK, which does not consider false positive detections, I think it would not matter.

[mks0601]

I cannot remember clearly, but I think you'd better use the evaluation script. You can download it from the official dataset page. The script outputs several .csv files, which contain the evaluation results including 3DPCKs. I used the .csv files to report the performance of my method.

[nicolasugrinovic]

Ok thank you