iceoryx icon indicating copy to clipboard operation
iceoryx copied to clipboard

Stress Test should not be running on the CI

Open elfenpiff opened this issue 2 years ago • 2 comments

Required information

When the CI is under heavy load stress test tend to fail with timeouts. Furthermore, the goal of a stress test to test the system under high contention which is not the case when a CI target has only one core and is under heavy load.

We need to enable the stress test in:

  • iceoryx_hoofs/test/integrationtests/test_lockfree_queue_stresstest.cpp
  • iceoryx_hoofs/test/integrationtests/test_resizeable_lockfree_queue_stresstest.cpp

again and find a better way of running them on a target which has enough cores and really run the stress test in a way they were meant to run.

elfenpiff avatar Mar 10 '22 18:03 elfenpiff

FYI @MatthiasKillat

elfenpiff avatar Mar 10 '22 18:03 elfenpiff

Agreed. Without sufficient cores the tests are meaningless and will often fail due to timeouts. However, they need timeouts to safeguard against potential deadlocks of the SUT (if there is a malfunction). The value of this timeout is also tricky, as it depends on the test and the system it is run on.

To solve this, we need to run them on a target with sufficient resources (mainly available cores).

MatthiasKillat avatar Mar 11 '22 08:03 MatthiasKillat