container icon indicating copy to clipboard operation
container copied to clipboard

Integration Tests don't run in robust manner

Open nyuuyn opened this issue 2 years ago • 5 comments

Current Behavior: Sometimes the tests fail and sometimes they don't, the behaviour is rather non-deteministic, since the tests are running in parallel now. Maybe the github flows are sharing some state? See e.g. #309

nyuuyn avatar Feb 02 '23 13:02 nyuuyn

@PhilWun @lharzenetter any insights ?

nyuuyn avatar Feb 02 '23 13:02 nyuuyn

I don't now why this appears: image

It seems like the test ran successfully but was canceled from the outside.

lharzenetter avatar Feb 02 '23 13:02 lharzenetter

some test fails and cancels the others but @mar-be and I are looking into and don't find proper issues. The tests run fine locally and after a restart on github as well

nyuuyn avatar Feb 02 '23 13:02 nyuuyn

According to https://github.com/actions/runner-images/issues/1918 this can happen if the job uses too much memory or a timeout was triggered. The timeout for the tests is 80 minutes so that shouldn't be the issue, but I don't know how much memory is available for the jobs.

PhilWun avatar Feb 02 '23 13:02 PhilWun

If we look into the logs of the runner/worker itself we see the following: image

Maybe the network is a bit full and then everything goes FUBAR? Or github itself has an issue right now?

nyuuyn avatar Feb 02 '23 13:02 nyuuyn