openpilot icon indicating copy to clipboard operation
openpilot copied to clipboard

[100$ bounty] get metadrive test running in CI

Open jnewb1 opened this issue 1 year ago • 2 comments

the metadrive test runs okay over here, but it fails about 1/20 times: https://github.com/commaai/openpilot/pull/30775

this bounty is to get this test to work 100% of the time in github actions.

requirements:

  • no services can be blocked, i.e. soundd and ui, (except the ones here that are normally blocked in the sim) https://github.com/commaai/openpilot/blob/ea57336005f4cf9c587dfbe221662b4de73bd508/tools/sim/launch_openpilot.sh#L9
  • must pass 50 times in CI. you can use a matrix to test lots of runs at once, though I would wait until you have it running consistently locally https://github.com/commaai/openpilot/blob/3001d67e64f22bff0fe9cbc8f29a51aa00ab80e4/.github/workflows/tools_tests.yaml#L67-L70

This is a sub-bounty of #30693, which requires that the simulator runs at the full 20 FPS. For this bounty, the simulator can run at 1-2 FPS (while still publishing frames at 20 FPS) as long as the rest of the openpilot stack is running in realtime.

jnewb1 avatar Jan 23 '24 18:01 jnewb1

Here it passed 100 times

https://github.com/jakethesnake420/openpilot/actions/runs/7671252393

seems to have died here after re running the jobs. https://github.com/jakethesnake420/openpilot/actions/runs/7671252393/job/20921767060

Gave it a go but I'm giving up for now. The threads seem to just completely lock up. Very time consuming to debug this.

jakethesnake420 avatar Jan 27 '24 01:01 jakethesnake420

Hey, I am interested to solve this

skushagra9 avatar Jan 28 '24 12:01 skushagra9