covid-sim icon indicating copy to clipboard operation
covid-sim copied to clipboard

Micro regression test needed

Open zebmason opened this issue 4 years ago • 5 comments

@weshinsley @dlaydon @NeilFerguson For debugging purposes, etc. Must work as many code paths as possible Completes in a few seconds

zebmason avatar May 24 '20 06:05 zebmason

@matt-gretton-dann Further thought is that on CI we should run (in order): build unit tests micro regression UK regression US regression

as the first step to fail causes the job to end

zebmason avatar May 24 '20 09:05 zebmason

@zebmason

Would it make sense for UK regression go last since it takes the longest? On my computer, US regression takes a couple minutes whereas UK regression takes 20-30 minutes.

ozmorph avatar May 24 '20 15:05 ozmorph

@ozmorph I never checked just presumed the US was larger.

zebmason avatar May 24 '20 15:05 zebmason

@zebmason No worries!

FYI for future reference, you can tell what each regression test is using by looking in the admin-params.txt file. The UK regression test includes Wales and the US regression test includes Wyoming. Presumably these were picked because they are the smallest administrative units for each country by population.

ozmorph avatar May 24 '20 20:05 ozmorph

One possibility is to run ctest --stop-on-failure

zebmason avatar Jun 27 '20 09:06 zebmason