Improvements related with rerun test jobs

[sophia-guo]

Rerun test jobs was recently enabled in adoptium, which definitely helps in the latest releases. Here are some thoughts or issues we met during the releases:

• [ ] for openjdk tests, rerun failed targets might cost. There might be a few test cases fail but the test target might include a few hundred of testcases. https://github.com/adoptium/aqa-tests/issues/5241
• [ ] there will be new intermittent failures during the rerun test target. I.e, the former failure test cases pass in the rerun test target while other former passing test cases fail in the rerun test target. If this is the case the status of rerun build is unstable, which need manually check and hence cause extra work.
• [x] rerun iteration, for now in adoptium it is set as 3. Tests will be rerun on same machine 3 times, if test targets fail once the job status will be marked as unstable. Wondered if 1 is enough as if test failures related to machine issues there is no need to rerun multiple times on same machine.
• [x] tap files are not archived to parent jobs https://github.com/adoptium/aqa-tests/issues/5015
• [ ] rerun job shows unstable, however the TEST TARGETS SUMMARY shows passed. - might be issue with tkg with iteration >1? https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.system_x86-64_mac_rerun/1/

• [ ] job with target as *_custom ( normally grinder job) can also trigger the rerun job. But rerun will fail if custom_target is not the default. https://github.com/adoptium/aqa-tests/issues/5388