pytest-random-order
pytest-random-order copied to clipboard
pytest-dev
pytest plugin to randomise the order of tests with some control over the randomness
Could you help to support the scenario of multiple process (the plugin "pytest-xdist": -n 6)? Thanks.
I find myself wanting to do multiple runs for maximum robustness. Maybe this could be added. Here's a bash script I use: ``` #!/bin/bash
Here https://pythonhosted.org/pytest-random-order/ an intro to this (very useful) plugin says that "The plugin is enabled by default.". This intro by Jazeps Basko is dated 2016. Maybe that was how it...
**Order-Dependent(OD)** tests are **flaky tests** whose results can differ depending on the order in which the tests run. An order-dependent test consistently passes when run in one order but then...
I often encounter this exception, especially when I previously ran pytest and a syntax error prevented it to run. ``` File "/usr/local/lib/python3.7/site-packages/random_order/plugin.py", line 60, in pytest_collection_modifyitems INTERNALERROR> process_failed_first_last_failed(session, config, items)...
The `none` value for random-order-bucket is deprecated. Here's a usecase that IMHO warrants keeping it. In our project, the top-level `setup.cfg` enables random-order by adding `addopts = --random-order`. From that...
After I installed this plugin I began seeing bizarre issues in my tests, like API returning 409 conflict claiming duplicate object creations. It took me a second and some time...
I would like to suggest you to move this cool plugin under pytest-dev organization for few reasons: - more chances that the project would receive maintenance help from others -...
#28 appears to have fixed a problem with the `--failed-first` option in 0.8.0, but `--failed-first` breaks for me in the latest version with the following traceback: ``` $ pytest --failed-first...
Metadata
Owner
Metadata
pytest plugin to randomise the order of tests with some control over the randomness