pytest-test-groups icon indicating copy to clipboard operation
pytest-test-groups copied to clipboard

Run tests in original order even when selected randomly

Open craigds opened this issue 7 years ago • 5 comments

--test-group-random-seed originally made tests run in a hard to predict order. For many codebases that's okay, but this is an unnecessary limitation which can cause non-determinism in test suites that aren't well-behaved.

This changes the --test-group-random-seed option to preserve the original ordering of the tests within each group.

craigds avatar Oct 16 '18 03:10 craigds

CI failure is related to python versions / test matrices rather than any code :)

rcoup avatar Oct 16 '18 08:10 rcoup

👋 any chance of merging this?

craigds avatar Nov 03 '18 06:11 craigds

@mark-adams could this be merged? or do you have some feedback I could incorporate to make it mergeable?

craigds avatar Aug 14 '19 00:08 craigds

Hey @craigds,

It looks like this has some conflicts now. Would you mind fixing them then I can take another look.

mark-adams avatar Dec 10 '19 15:12 mark-adams

@mark-adams I've rebased my branch on latest master

craigds avatar Dec 12 '19 23:12 craigds