flaky icon indicating copy to clipboard operation
flaky copied to clipboard

Flaky decorators on individual tests have no effect if `--force-flaky` argument is passed

Open tdluk opened this issue 2 months ago • 1 comments

From README.rst:

Pass --max-runs=MAX_RUNS and/or --min-passes=MIN_PASSES to control the behavior of flaky if --force-flaky is specified. Flaky decorators on individual tests will override these defaults.

However, flaky decorators on individual tests do not override these defaults.

To repro the issue, consider the following test file test.py:

import pytest

@pytest.mark.flaky(max_runs=10)
def test_foo():
    assert False

Then run pytest test.py --force-flaky and observe the test was run the default 2 times instead of the 10 specified by the decorator.

tdluk avatar Apr 16 '24 10:04 tdluk