sdmTMB icon indicating copy to clipboard operation
sdmTMB copied to clipboard

Add unit testing against VAST

Open seananderson opened this issue 2 years ago • 3 comments

Will have to be outside the usual testthat folder (for now in a folder in inst?) or skipped in all but local runs, which might be ideal assuming it doesn't upset CRAN to have packages loaded in non-run tests that aren't in 'suggests'.

See https://github.com/seananderson/sdmTMB-paper/blob/main/doc/appendix-pcod-VAST.Rmd (delta-Gamma) https://github.com/seananderson/sdmTMB-paper/blob/main/doc/appendix-pcod-VAST-tweedie.Rmd (Tweedie) for a starting point.

Test Tweedie, delta-Gamma, delta-lognormal, anything else easily matching? Test parameter estimates, predictions, COG, and index values Test bias correction Make sure to use exact same mesh as is done above Test various spatiotemporal structures (IID, AR1, RW)

seananderson avatar May 03 '22 21:05 seananderson

Just wanted to let you know I'm working on this! https://github.com/pbs-assess/sdmTMB/blob/bc0f43658a8daf41ee0cd174297e16e18046d265/julia-tests/test-1-vast.R

jindivero avatar May 16 '22 17:05 jindivero

There has been a bunch of work over here on this: https://github.com/kellijohnson-NOAA/indexwc/blob/main/sandbox/run_index_comparison.R

We have everything matching exactly so far. It's complicated enough, we may want a separate repo that runs a bunch of comparisons. Or a folder in this repo that is ignored when building the package.

seananderson avatar May 24 '22 22:05 seananderson

My suggestion would be to create a new repository that runs comparisons on a schedule. That way it can have its own README file etc.

kellijohnson-NOAA avatar May 25 '22 15:05 kellijohnson-NOAA