pytest-tap icon indicating copy to clipboard operation
pytest-tap copied to clipboard

Counting failing xfail tests as ok

Open lorcap opened this issue 2 months ago • 0 comments

Currently, if a test marked in Pytest as xfail (expected to fail) actually fails, it increments the count of not-ok tests. My proposal consists in adding a new option --tap-xfail-ok which counts non-strict failing xfail tests as ok.

Rationale: an xfail test is neither a fail nor a pass test. User might want to run xfail tests and successfully pass the CI, knowing that those tests will be fixed in a future version.

lorcap avatar Dec 10 '24 13:12 lorcap