loam_velodyne icon indicating copy to clipboard operation
loam_velodyne copied to clipboard

Some questions about system performance

Open SakuraMemoryKnight opened this issue 4 years ago • 4 comments

I read some of the papers on slam, and I found that in these papers the performance of slam was usually evaluated with the average relative translation (%) and rotation (deg/m), It's just like the kitti list shows: 77239946-483b8b00-6c1b-11ea-8c01-f2276333e6ae How to get this result? In fact, I don't quite understand the meaning of these two evaluation indexes, so I don't know what the formula is for this parameter. I have used evo to test the slam performance results, and can get ape and rpe, but these are not the above two evaluation parameters. I just want to know what their formula is. Is it the absolute error of the final frame divided by the total distance?

SakuraMemoryKnight avatar Apr 06 '20 06:04 SakuraMemoryKnight

Just look at the text behind this table, there are information you need. "our evaluation computes translational and rotational errors for all possible subsequences of length (100,...,800) meters. The evaluation table below ranks methods according to the average of those values, where errors are measured in percent (for translation) and in degrees per meter (for rotation). A more detailed comparison for different trajectory lengths and driving speeds can be found in the plots underneath"

RuanJY avatar Mar 01 '21 03:03 RuanJY

I read some of the papers on slam, and I found that in these papers the performance of slam was usually evaluated with the average relative translation (%) and rotation (deg/m), It's just like the kitti list shows: 77239946-483b8b00-6c1b-11ea-8c01-f2276333e6ae How to get this result? In fact, I don't quite understand the meaning of these two evaluation indexes, so I don't know what the formula is for this parameter. I have used evo to test the slam performance results, and can get ape and rpe, but these are not the above two evaluation parameters. I just want to know what their formula is. Is it the absolute error of the final frame divided by the total distance?

Hi, brother, do you know how to use Evo to measure these two parameters of Kitti? Can you give me some advises?

lgm051 avatar Dec 09 '21 13:12 lgm051

Read their README. btw, I use this one: https://github.com/LeoQLi/KITTI_odometry_evaluation_tool, it works ok.

RuanJY avatar Dec 10 '21 02:12 RuanJY

I read some of the papers on slam, and I found that in these papers the performance of slam was usually evaluated with the average relative translation (%) and rotation (deg/m), It's just like the kitti list shows: 77239946-483b8b00-6c1b-11ea-8c01-f2276333e6ae How to get this result? In fact, I don't quite understand the meaning of these two evaluation indexes, so I don't know what the formula is for this parameter. I have used evo to test the slam performance results, and can get ape and rpe, but these are not the above two evaluation parameters. I just want to know what their formula is. Is it the absolute error of the final frame divided by the total distance?

Hi, brother, do you know how to use Evo to measure these two parameters of Kitti? Can you give me some advises?

No, I just get rpe,ape,rte,ate with the EVO, but I wrote and calculated the average translation error and rotation error of the first 800 meters according to Kitti's instructions.

SakuraMemoryKnight avatar Dec 31 '21 06:12 SakuraMemoryKnight