os-autoinst-distri-opensuse icon indicating copy to clipboard operation
os-autoinst-distri-opensuse copied to clipboard

Published 20 hours ago • verified publisher icon os-autoinst

Run unit test shuffled and timed

Open mpagot opened this issue 4 months ago • 2 comments

Add two additional commands in the unit-test target:

  1. run the test with --shuffle argument: it randomly change the execution order. Comparing the result with the previous in-order execution can spot test dependency issues.
  2. run test with --timer, parse and order the result to print the test in order of time to run. In can help to spot tests taking too much time as maybe using not "mocked" sleep.
  • Verification run: https://github.com/os-autoinst/os-autoinst-distri-opensuse/actions/runs/11272220692/job/31346686699?pr=20374#step:6:306

mpagot avatar Oct 10 '24 10:10 mpagot