pytest-randomly
pytest-randomly copied to clipboard
pytest-dev
:game_die: Pytest plugin to randomly order tests and control random.seed
### Description We're trying to transition to randomised tests, and this is a feature that I feel strongly about as a helpful one in the period of transition when you...
### Description In #463 , numpy tests were disabled for Python 3.11, because it didn't support Python 3.11. Once it does, re-enable installing numpy and running its tests.
Is it possible to use `pytest-randomly` but selectively disable shuffling of functions in classes? Similar to https://github.com/jbasko/pytest-random-order#disable-shuffling-in-module-or-class This could allow incremental tests, as described in https://docs.pytest.org/en/stable/example/simple.html#incremental-testing-test-steps but still allow some...
I wish to run as many tests as possible using a random order and have this as the default. But for the ones which cannot run in random order, I...
Once you have tests that fail only when run in a particular order, it'd be incredibly useful to have sort of support for automatically determining what the minimum set of...
would it be possible to get pytest-randomly to shuffle based on overlapping fixture scopes rather than just module, class, fn
`nose-randomly` has the feature that `nosetests path.One path.Two` still runs `path.One` and `path.Two` in order, allowing reproduction with `--randomly-seed=X` much easier - once you've found a bad test order, just...
Tests and README are included. Add support for setting tensorflow and pytorch random seed. It can help detect flaky tests due to the randomness, and provide reproducibility. Reference: [1] Dutta,...
### Description Per https://github.com/pytest-dev/pytest-randomly/issues/531 its unexpected that randomly generated values in different tests would be identical. It's common in test suites to use randomly generated identifiers to help maintain test...
Metadata
Owner
Metadata
:game_die: Pytest plugin to randomly order tests and control random.seed