Moving infrequently failing tests into the usual exclude files
This excludes any tests that could interrupt a release, and also helps keep our test runs green at the expense of nonblocker test executions. Plus it reduces complexity by reducing the number of exclude files, which makes maintenance easier.
Note 1: All "unreliable" tests excluded in this commit have been identified as not blocking a release (nonblocker) in at least one previous release cycle.
Note 2: The issues related to these infrequently failing tests will be updated to include a title change and an additional tag to indicate they they are infrequent failure.
@sophia-guo - Do you think this PR can go in in parallel to that work, or do you feel we should hold fire until the related issues are updated?
Resolves https://github.com/adoptium/aqa-tests/issues/6593
I am looking at the issue links under which these exclusions are being done, and we should not be referring to release triage issues such as https://github.com/adoptium/aqa-tests/issues/6421
I am looking at the issue links under which these exclusions are being done, and we should not be referring to release triage issues such as #6421
Fair enough. Will screen them out.
It seems many of the triage issues have expired job links, so I'm going through each of the failing unit tests and identifying the actual problem for each based on more recent test runs. I'll keep an eye out for failures sharing symptoms (with each other and existing issues).
Plan: For each unreliable test:
- If a test is linked to a triage issue, comment out the line.
- Uncomment the line after one of these:
- Finding an issue for the failure
- Raising an issue for the failure
- Reproducing the failure and then raising an issue
Grinders:
JDK11:
- https://ci.adoptium.net/job/Grinder/15746/
- https://ci.adoptium.net/job/Grinder/15747/
- https://ci.adoptium.net/job/Grinder/15748/