FL3D icon indicating copy to clipboard operation
FL3D copied to clipboard

overlap threshold {0.5, 0.25, 0.25} need to be changed as official {0.7, 0.5, 0.5}

Open nyg2017 opened this issue 5 years ago • 3 comments

There is a problem in eval code(evaluate_object_3d_offline.cpp), the overlap threshold should be changed as official {0.7, 0.5, 0.5}. Now it's {0.5, 0.25, 0.25}(for 3d and image/ground plane).

nyg2017 avatar Sep 20 '18 05:09 nyg2017

The minimum overlap threshold for 2D evaluation on the image/ground plane and 3D evaluation is indeed 0.7, 0.5, 0.5 for car class. Please check again. :)

pyun-ram avatar Dec 05 '18 05:12 pyun-ram

The minimum overlap threshold for 2D evaluation on the image/ground plane and 3D evaluation is indeed 0.7, 0.5, 0.5 for car class. Please check again. :)

why the code in FL3D/VoxelNet/kitti_eval/evaluate_object_3d_offline.cpp
line54 is: const double MIN_OVERLAP[3][3] = {{0.7, 0.5, 0.5}, {0.5, 0.25, 0.25}, {0.5, 0.25,0.25}};` and I evaluate the validation dataset by the evaluate code of project "qianguih/voxelnet". It's totally different.

nyg2017 avatar Dec 05 '18 06:12 nyg2017

In MIN_OVERLAP Matrix: {{0.7, 0.5, 0.5}, {0.5, 0.25, 0.25}, {0.5, 0.25,0.25}}, each row is for a specific task: 2D evaluation on the image plane, 2D evaluation on the ground plane and 3D evaluation. Each column is for a specific class: car, pedestrian, cyclist. This code coincides with https://github.com/prclibo/kitti_eval. Of course, you can change this cpp for whatever you need. :)

pyun-ram avatar Dec 05 '18 06:12 pyun-ram