Offline Evaluation Code

[mstrctrlpgrm]

Hello there,

Thanks for the great code you are supplying! I have a question regarding the offline evaluation code. I'm trying to verify that it works by using a singe ground truth file twice, once as gt and once as detection as input for the evaluation program. I changed gt file so it adheres to the kitti detection standard (basically just adding a score as 16th column). Therefore I should get 100% AP correct? The actual results from my tests differ, depending on the file used I sometimes get somewhere between 0 and 36% AP.

Am I using the eval tool wrong? Does it need a minimum number of detections (that's why it fails in this simple test case?)? Do I need to modify the evaluation code somehow so it works with the standard kitti detection result format?

Thanks again!

[kikacaty]

@mstrctrlpgrm Hi, have you resolved this issue yet? I found that the image and the point cloud data is not actually matched based on the visualization results. However, I don't know how the point cloud data is matched with the image data. I was assuming they are synced by the filename.