TraceR icon indicating copy to clipboard operation
TraceR copied to clipboard

Run regression tests on Travis

Open nightlark opened this issue 6 years ago • 3 comments

Runs stencil4d-otf example using the dragonfly, fattree, and hypre, and torus network configurations, and compares the resulting output files to a baseline set of output files.

  • Some times check to make sure the value is within a tolerance; some floating point time values are very slightly (10^-6) different on Travis than when the same test and code is run on LC
  • Busy time in msg-stats files are ignored; they vary significantly between runs even on the same machine

nightlark avatar Sep 05 '19 00:09 nightlark

The push build for this branch passes: https://travis-ci.com/nightlark/TraceR/builds/129162778

The failure is because https://github.com/LLNL/TraceR/pull/38 resulted in values changing in the CODES output files, as well as the TraceR WallTime values printed out.

nightlark avatar Sep 25 '19 19:09 nightlark

Given recent changes to Travis, I don't think running tests there is as good as it used to be. Would be better to use GitHub Actions now.

nightlark avatar Jan 30 '21 00:01 nightlark

Given recent changes to Travis, I don't think running tests there is as good as it used to be. Would be better to use GitHub Actions now.

Yes we are planning to move to GitHub actions soon.

bhatele avatar Feb 24 '21 16:02 bhatele