Perception evaluation with sample_dataset

[muensterjan]

Hello everybody,

I followed the installation guide to set up the perception evaluation and used the sample_dataset to check the evaluation, as described in Quick Start/ Perception Evaluation.

The results of the simulation are always like this:

$ driving_log_replayer simulation run -p perception --rate 0.5 . . . test case 1 / 1 : use case: sample_dataset

---

TestResult: Failed Failed: 6 / 19 -> 31.58%

The number of executed tests varies between "NoData" and ~ 50. But the result is "Failed" every time. It seems like the point cloud only refreshes sporadically in rviz2. The /sensing/lidar/concatenated/pointcloud Topic has an average rate of 0.3-0.4 Hz while testing.

The workload of the used PC is not a problem. Am I doing something wrong?

Thank you!