AWSIM icon indicating copy to clipboard operation
AWSIM copied to clipboard

Can AWSIM simulates the camera_lidar_fusion perception mode of Autoware.Universe?

Open ZiweiSong96 opened this issue 1 year ago • 4 comments

AWSIM quick start demo only use camera for traffic light detection, and the perception mode was selected as "lidar", So I changed the perception mode in launch file and set the traffic light camera sensing topic as the input of 2D camera perception (tensorrt_yolo). Screenshot from 2024-01-29 18-55-44 Screenshot from 2024-01-29 18-55-09 Screenshot from 2024-01-29 19-01-06 But I found that this cannot work well. So I wonder is that possible for users to simulate the camera_lidar_fusion perception mode in AWSIM? Thank you for your kind help during this time.

ZiweiSong96 avatar Jan 29 '24 11:01 ZiweiSong96

I have not tried it yet. It's a future task.

mackierx111 avatar Mar 12 '24 10:03 mackierx111

I wrote a ROS2 node and remapped the camera topic of traffic light classification to the camera perception topic, I found that the yolov function was launched in this way. Maybe this can be used for 2D 3D fusion simulation as an alternative plan.

ZiweiSong96 avatar Mar 12 '24 10:03 ZiweiSong96

I would like to do this too.

@ZiweiSong96

Could you please tell me the code or procedure for the remapping?

l7u7ch avatar Jun 10 '24 04:06 l7u7ch

I would like to do this too.

@ZiweiSong96

Could you please tell me the code or procedure for the remapping?

It is really a naive solution, if you want to do soo, you can find the repo in my github repositories. Feel free to connect with me anytime.

ZiweiSong96 avatar Jun 12 '24 12:06 ZiweiSong96