OpenSearch
                                
                                 OpenSearch copied to clipboard
                                
                                    OpenSearch copied to clipboard
                            
                            
                            
                        [Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness
Is your feature request related to a problem? Please describe.
- gradle checktest failures are now retried as a part of https://github.com/opensearch-project/OpenSearch/pull/2638
- This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status
Describe the solution you'd like
- As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
- The generated report has a log of the tests that fail even though the overall job succeeds
- Record the frequent offenders to address and mitigate the underlying root cause for flakiness
Describe alternatives you've considered
- Manually keeping track of failed tests from the gradle checkbot reports
Additional context
- N/A
Hi @kotwanikunal,
I'd like to contribute to this issue!
@yeohbraddy Thanks. Let me know if you have any queries around this.