flaky
flaky copied to clipboard
box
Plugin for nose or pytest that automatically reruns flaky tests.
Since upgrading to `pytest>=7.0.0`, the `self` parameter between test runs remain the same when retrying a single test function within a test class. When using `pytest==6.5.2`, it is working as...
From `README.rst`: > Pass --max-runs=MAX_RUNS and/or --min-passes=MIN_PASSES to control the behavior of flaky if --force-flaky is specified. Flaky decorators on individual tests will override these defaults. However, flaky decorators on...
When a test fails and is rerun, Flaky reruns session-scoped autouse fixtures. For example, running this test: ``` import pytest @pytest.fixture(scope="session", autouse=True) def my_session_scoped_autouse_fixture(): print("\nIn session scope autouse fixture") @pytest.mark.flaky(max_runs=3)...
Last commit was 2 years ago, last release was 3 years ago. Since this project is very important to the python ecosystem, would you please transfer ownership to an entity...
I am finding that the `rerun_filter` function is called twice per test. Version: 3.6.1 Pytest version: 5.4.3 Here is some sample code to recreate the problem: ``` def my_rerun_filter(*args): log.debug("ran...
Latest `pytest`, `pytest-asyncio` and `flaky` just can't live happily together. When a flaky test fails, an error `RuntimeError: Event loop` is closed is reported instead of failure. Edit: In fact,...
Hi, I was wondering if it is possible to pass in the new SeedSequence from numpy into flaky so that way one can get different test runs over the flaky...
Given a flaky test such as: ``` def test_random(): assert bool(random.getrandbits(1)) ``` The output of the JUnit XML contains no `` information when a test case fails and then subsequently...
The sdist at PyPI is missing `tox.ini` and related files `requirements-dev.txt` and `requirements.txt`. Please add these files to sdist to make downstream testing easier. Thank you.
