covid-sim
covid-sim copied to clipboard
Micro regression test needed
@weshinsley @dlaydon @NeilFerguson For debugging purposes, etc. Must work as many code paths as possible Completes in a few seconds
@matt-gretton-dann Further thought is that on CI we should run (in order): build unit tests micro regression UK regression US regression
as the first step to fail causes the job to end
@zebmason
Would it make sense for UK regression go last since it takes the longest? On my computer, US regression takes a couple minutes whereas UK regression takes 20-30 minutes.
@ozmorph I never checked just presumed the US was larger.
@zebmason No worries!
FYI for future reference, you can tell what each regression test is using by looking in the admin-params.txt file. The UK regression test includes Wales and the US regression test includes Wyoming. Presumably these were picked because they are the smallest administrative units for each country by population.
One possibility is to run ctest --stop-on-failure