carla icon indicating copy to clipboard operation
carla copied to clipboard

Many buildings are not perceived by the LiDAR sensor

Open vbrebion opened this issue 3 years ago • 1 comments

Hi!

As part of my research work, I am currently generating perception data with CARLA for learning purposes. However, it appears that the LiDAR sensor (which is a key component for me) is unable to perceive many buildings, and thus returns erroneous data.

Would it be possible for you to take a look at this issue?

Best, Vincent


CARLA versions: 0.9.13; nightly

Platform/OS: Ubuntu 20.04

Problem you have experienced: When I use the LiDAR sensor, many buildings appear to be completely invisible, while they are correctly perceived by other sensors.

  • A first example, in the Town01 map:

    town01_rgb RGB reference

    town01_depth Depth reference

    town01_lidar Projected LiDAR data

    town01_depth_lidar Superimposed depth and LiDAR data. Notice the incorrect superimposition for the two large buildings on the right, as well as the two distant buildings on the center-left.

  • Another example, in the Town10HD map:

    town10hd_rgb RGB reference

    town10hd_depth Depth reference

    town10hd_lidar Projected LiDAR data

    town10hd_depth_lidar Superimposed depth and LiDAR data. This time, all the buildings are missing, as well as some other elements, like the flags on the poles (edit: the issue with the flags seems to have already been fixed in the development version).

Steps to reproduce:

  • Load any map with buildings in them (Town10HD is where the issue seems to appear the most)
  • Spawn a LiDAR (I configured it here with a large FOV and many channels for a good visualization of the issue)
  • Spawn a depth camera
  • Compare the buildings in the projected LiDAR data and in the depth images

Other information (documentation you consulted, workarounds you tried):

vbrebion avatar Sep 06 '22 15:09 vbrebion

I also encounter a similar issue using Town10HD with Carla 0.9.11, image

DarrenWong avatar Sep 21 '22 02:09 DarrenWong

Hey @vbrebion, that is indeed the case, thanks for reporting this :+1: . Apparatenly, due to some missconfigurations, some assets are invisible for the LIDAR. We'll be checking all our towns, making sure this is no longer the case, and I'll report back once it's fixed.

glopezdiest avatar Sep 23 '22 06:09 glopezdiest

Any update on this? Thanks!

heiwang1997 avatar Oct 03 '22 07:10 heiwang1997

Yes, we just fixed it last week and it is already in master.

Feel free to reopen the issue if you see any assets that aren't detected by the LIDAR

glopezdiest avatar Oct 03 '22 07:10 glopezdiest

@glopezdiest Thank you for your work! This sounds great!

Could you please inform me where can I see the latest changes? For me the latest commit in master is still 8854804, which is November last year...

Are you referring to dev branch instead?

heiwang1997 avatar Oct 03 '22 07:10 heiwang1997

I tried today's dev branch should be ok to detect the building in Town10. Thanks a lot!

image

I also encounter a similar issue using Town10HD with Carla 0.9.11, image

DarrenWong avatar Nov 21 '22 10:11 DarrenWong