feat(reporter): add `ignoreFailedRetries` option to avoid duplicate results during retries
What
This MR introduces a new reporter option: ignoreFailedRetries.
When enabled, the reporter will skip all failed retry attempts if the test eventually passes. This helps reduce noise and avoids sending multiple results for the same test case.
Why
In Zephyr, each retry attempt can create a separate test result with a different status (e.g. "blocked", "failed") within the same test cycle. This leads to confusion and inflated reporting, even when the test eventually succeeds.
By enabling ignoreFailedRetries, only the first successful retry is reported — resulting in cleaner and more accurate test cycles.
Changes
- ✅ Added
ignoreFailedRetriesflag to the reporter config (default:false) - ✅ Implemented filtering logic in
onTestEnd - ✅ Updated README with usage example and rationale
- ✅ Added test to verify
ignoreFailedRetriesbehavior
Backward Compatibility
- ✅ Feature is disabled by default, preserving current behavior for existing users
@elaichenkov I'd appreciate your review whenever you have a chance 🙌 Let me know if anything needs to be adjusted!
Hi @yarikpavlin,
Thank you for your contribution. Have you tested these changes with your zephyr? Which one do you have? Cloud or server? I don't have access to the zephyr anymore so can't test it.