Aviary icon indicating copy to clipboard operation
Aviary copied to clipboard

Add regression testing capability

Open jkirk5 opened this issue 1 year ago • 1 comments

Desired capability or behavior.

via @robfalck As we're reworking phases, we can check performance against the nominal GASP results but that data isn't very detailed. We should also save more detailed results from each run (the test_phase scripts (currently run_phase scripts) should nominally test against this regression data using the assert_timeseries_near_equal function in dymos.

To do this, we should save all timeseries data off using the numpy.savetxt function in order to keep it as ascii (which is better for git than the binary database files). The regression testing scripts should optionally overwrite current regression data when the team decides it is appropriate to do so.

Is your feature request related to a problem? Please describe.

No response

Associated Bug Report

No response

jkirk5 avatar Jun 27 '24 18:06 jkirk5

This suggestion needs to be re-visited for the current Aviary version - do we still desire this capability?

jkirk5 avatar Jun 27 '24 18:06 jkirk5