nf-test icon indicating copy to clipboard operation
nf-test copied to clipboard

Order of tests in the snapshot is non-deterministic

Open maxulysse opened this issue 1 year ago • 0 comments

For example in https://github.com/nf-core/references/pull/39

I have 2 tests in tests/kallisto.nf.test:

  • Run with profile test for kallisto | --input GRCh38_chr21.yml
  • Run with profile test for kallisto | --input assets/genomes/test/pipelines/default_extended.yml

Somehow the order of these tests changed in the snapshot file (tests/kallisto.nf.test.snap). (I don't remember if I deleted the snapshots before I regenerated, or used --cleanSnapshot)

And it becomes a bit more complicated to figure out if what I have changed affect one or both tests.

(simple to figure out on simple tests, but could be much more complex and messy on bigger tests).

maxulysse avatar Nov 28 '24 12:11 maxulysse