support retry of failure

[guoweis-work]

I have been using venom. Since this is real-life, e2e testing, sometimes there is instability in the environment which could cause test failure. Instead of rerunning everything, which is time consuming, I'm hoping we could have a feature to just retry the failed ones up to X time.

if this seems a reasonable idea to you, I'd love to submit a PR for this. Thoughts?

[djloude]

Check this out and see if it fits your use case: https://github.com/ovh/venom#testsuites the very last example there are keys retry: # (this is the number of times the test will re-try if it fails) retry_if: (this is a list of conditions that will cause the test to fail and retry) delay: # (this is the number of seconds to wait in between each failed test)

[guoweis-work]

my test cases have dependency. i.e. i use the output from one test case as input to next one. What I want to retry is the whole test suite, not just a single test case

[fsamin]

Hello @guoweis-outreach, You would like to retry a whole testsuite, or just a testcase ?

[yesnault]

I close this issue, it has been inactive for a while. Feel free to reopen if needed.