Kaan Çolak

@1222-takeshi I approved your review request, but this pull request is still a draft.

I shared the initial 3D tracking benchmark results in the README file of the PR [link](https://github.com/kaancolak/autoware.universe/blob/565-perception-benchmark-tool/benchmarking/perception_benchmark_tool/README.md). It contains only the results of the lidar-only pipeline. For running the camera-lidar-fusion pipeline,...

@aohsato @yukkysaito @miursh @yukke42 @1222-takeshi @mitsudome-r @xmfcx

Thanks, @miursh for your feedback. Actually, I talked to Fatih when I first started this tool, he advised this directory structure. It can also take place in Perception, but some...

In the Autoware.Auto, we have 2D and 3D detection benchmark tools for the KITTI dataset. We can test our 2D/3D detections by integrating these tools into Autoware.Universe. In addition, I...

 I shared high-level architecture for the planned perception benchmark pipeline. If you have any comments feel free to share them with us. **Limitations when benchmarking with the Waymo dataset:**...

I shared the initial 3D tracking benchmark results in the README file of the PR. It contains only the results of the lidar-only pipeline. For vehicles, everything works fine, but...

@WJaworskiRobotec Thanks for your feedback. Current benchmarking tool scripts subscribe to ROS2 topics and convert the tracked objects to the proto format desired by the Waymo dataset. If we want...

@WJaworskiRobotec Instead of working on the different benchmarking pipelines, I think we can extend the metric calculation node. It's a more generic evaluator that contains the entire stack(evaluator, planning, control,...

This PR waiting for review.