openpilot icon indicating copy to clipboard operation
openpilot copied to clipboard

simulator: sensors aren't filled

Open sshane opened this issue 1 year ago • 3 comments

The IMUState is never updated, so locationd is getting 0s for the sensor data, and then paramsd learns a bad offset, preventing from merging a fix to the steering angle: https://github.com/commaai/openpilot/pull/33718

https://github.com/commaai/openpilot/blob/72e19ccfc6de0a145bf778fdc701878f969347bb/tools/sim/lib/common.py#L30-L34

We may be able to fake these sensors with the vehicle state:

metadrive_vehicle_state(velocity=vec3(x=3.250601291656494, y=10.504247665405273, z=0), position=(217.0621795654297, 82.05776977539062), bearing=72.51176834106445, steering_angle=7.866117000579834)

sshane avatar Oct 03 '24 22:10 sshane

I'm wondering what to do with the gyroscope value for IMUState. Metadrive does neither offer a simulated value for gyroscope nor for direction. We can just get the bearing value in this function and store it in the state.imu.bearing variable. I guess the acceleration can also be calculated based on the last timestamp and last stored velocity and current velocity. But the gyroscope has to be kinda hacked, to be calculated based on the acceleration and direction the car is heading and even then it is really inaccurate. Or is it just that the value should stay zero?

schmxtz avatar Oct 15 '24 08:10 schmxtz

hey @sshane , i would like to take up this issue . i think i have a code in line with @schmxtz 's suggestion that would solve this issue . if your okay with it , i'd like to work on this and resolve it asap .

sambhavnoobcoder avatar Oct 19 '24 16:10 sambhavnoobcoder

@sshane is anybody working on this? I would like to take it up

raf-fonseca avatar Apr 18 '25 14:04 raf-fonseca

Hey

Just following up on PR (https://github.com/commaai/openpilot/commit/7cd2bdaf300d66d0462a8762acf57c652ce5c558) — it fixes IMU sensor readings(https://github.com/commaai/openpilot/issues/33721). I've addressed the feedback and ensured everything passes the checks.

Let me know if there’s anything else you'd like me to tweak — happy to iterate!

Thanks again

zarisss avatar Jun 13 '25 03:06 zarisss

attempt #33721

imshivamchoudhary avatar Sep 11 '25 08:09 imshivamchoudhary