flaky
flaky copied to clipboard
box
Plugin for nose or pytest that automatically reruns flaky tests.
I have a set of tests I run with `pytest` in my Windows build in on GH Actions. I originally wrote this up as a `pytest` issue: https://github.com/pytest-dev/pytest/discussions/9321 you can...
The Flaky documentation mentions how to run tests using nosetest and pytest, but not using unittests, perhaps it could be added?
If I mark a test as xfail (expected to fail), then flaky shouldn't re-run the test when it fails. Additionally, xfail tests are counted twice, while regular failing tests are...
The deprecated aliases were removed in Python 3.11 in python/cpython#28268 ``` test/test_nose/test_flaky_nose_plugin.py: self.assertDictContainsSubset( test/test_flaky_decorator.py: self.assertDictContainsSubset( ```
`nose` is no longer maintained since 2016 https://github.com/nose-devs/nose/ Generally speaking `nose` is for python 2.x. I would recommend switch completely to `pytest` https://docs.nose2.io/en/latest/differences.html ```console + /usr/bin/pytest -ra =========================================================================== test session...
On self testting pytest flaky fails with: ```console INTERNALERROR> Traceback (most recent call last): INTERNALERROR> ... INTERNALERROR> File "/usr/lib/python3.8/site-packages/flaky/flaky_pytest_plugin.py", line 139, in call_and_report INTERNALERROR> self._call_infos[item][when] = call INTERNALERROR> KeyError: ```...
``` + PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-flaky-3.7.0-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-flaky-3.7.0-2.fc35.x86_64/usr/lib/python3.8/site-packages + /usr/bin/python3 -Bm pytest -ra =========================================================================== test session starts ============================================================================ platform linux -- Python 3.8.9, pytest-6.2.3, py-1.10.0, pluggy-0.13.1 rootdir: /home/tkloczko/rpmbuild/BUILD/flaky-3.7.0 plugins: flaky-3.7.0, forked-1.3.0, shutil-1.7.0, virtualenv-1.7.0, asyncio-0.14.0, expect-1.1.0,...
Currently there is no way to read **===Flaky Test Report===** details through any hook or fixture. There is a need to read this test report and write it to different...
When running mypy on the code that uses flaky, you get: ``` Skipping analyzing 'flaky': found module but no type hints or library stubs ``` [Here](https://mypy.readthedocs.io/en/latest/running_mypy.html#missing-type-hints-for-third-party-library) is how it can...
I am a maintainer of Python packages in openSUSE, and I am on my crusade of eliminating nose1 from our distribution. When I look at its repository on https://github.com/nose-devs/nose, the...
