openpilot icon indicating copy to clipboard operation
openpilot copied to clipboard

Simulator: update image output to NV12 from YUV420

Open jeroenlammersma opened this issue 3 years ago • 1 comments

Describe the bug

I noticed that since commit ea5b8cd (nv12: encoderd avoids a full frame copy) the simulator is displaying in grayscale. Also a black oval shape appears at the bottom of the screen. See the image below.

Is this supposed to happen after these changes, or is there maybe some configuration/installation or graphics driver issue what I might be facing? CARLA itself (/opt/carla-simulator/CarlaUE4.sh) runs in color just fine. It's the image stream coming from openpilot that's in grayscale. I also re-installed Ubuntu 20.04 and openpilot, but the issue was not resolved. I am running the current latest version of openpilot.

If this is the expected side effect, is there a way to get it in color again? And would this be an easy or difficult fix? I am happily willing to look into this issue, but I have no idea where to look or where to even start.

openpilot-sim-greyscale

OS Version

Ubuntu 20.04

openpilot version or commit

3fc001c945bb5e9092050bac1e55267dab63b9eb

Additional info

  • CPU: AMD Ryzen 9 5900x
  • GPU: NVIDIA RTX 3070
    • Driver Version: 515.65.01

jeroenlammersma avatar Aug 16 '22 13:08 jeroenlammersma

The CARLA bridge is still outputting images in YUY420; it just needs to be updated to NV12.

adeebshihadeh avatar Aug 16 '22 21:08 adeebshihadeh

Done in #26169

adeebshihadeh avatar Nov 10 '22 06:11 adeebshihadeh