SimEng icon indicating copy to clipboard operation
SimEng copied to clipboard

Overhaul the Jenkin's test pipeline

Open FinnWilkinson opened this issue 2 years ago • 1 comments

Additional to the current regression testing and performance testing that the Jenkin's pipeline does, it needs to be updated to a) test more benchmakrs, b) ensure said benchmarks are functionally correct, and c) ensure that the pass/fail criteria of performance tests are robust and consistent.

We have also seen unexpected errors and behaviour when running SimEng on different Linux distributions / Operating systems. Hence, the testing that a new PR undergoes should include running tests on multiple operating systems - perhaps via docker instances

FinnWilkinson avatar Nov 02 '23 17:11 FinnWilkinson

This should address issue #36

FinnWilkinson avatar Nov 02 '23 17:11 FinnWilkinson