py-motmetrics
py-motmetrics copied to clipboard
unexpected result when inputing ground truth as test set
Hi, I'm using the CLI and I'm getting confused with what it is doing. I tried using the same dataset as ground truth data and test data. In my understanding, the test data is my hypothesis of the tracker. So, if I input the same dataset, there should be no false positive. But I get this result. I'm using the MOT16-02 form motchallenge. IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP MOT16-02 75.8% 61.1% 100.0% 100.0% 61.1% 54 54 0 0 11360 0 0 0 36.3% 0.000 OVERALL 75.8% 61.1% 100.0% 100.0% 61.1% 54 54 0 0 11360 0 0 0 36.3% 0.000
this might be caused by duplicate ids in single frames as reported in #60.
In https://github.com/cheind/py-motmetrics/issues/48, when only observations with label ID=1 (Pedestrian) in the MOT16-02 challenge is used, inputting ground truth as the test set gives expected results.
Also, @cheind, I checked and there are no duplicate ids in single frames for the MOT16-02 data. The issue might have something to do with the label.

Interesting. I hope to find some time to inspect soon.
Might be related to #115