infrastructure icon indicating copy to clipboard operation
infrastructure copied to clipboard

Add template for tests on new platform/distribution environments

Open sxa opened this issue 8 months ago • 1 comments

As per https://github.com/adoptium/infrastructure/blob/master/FAQ.md#adding-new-systems we have a processs whereby new types of machines (New OS versions, new distributions etc.) Are run through an AQA_Test_Pipeline run.

It would be good if we had a standard template for logging the results of this e.g.

Key:

  • ✅ - All test cases pass
  • ⚠️ - Test suite had failures, but they are all covered by existing issues
  • ❌ - New unexpected (or untracked) failures which are of concern as they may indicate issues with this combination

Ubuntu 24.04 / JDK17 / aarch64

Test suite Result ✅⚠️❌
sanity.functional
extended.functional
special.functional ❌ (List of failing cases + link to new issue)
sanity.openjdk ⚠️ (IssueLink1, Issuelink2)
extended.openjdk ❌ (List of:failing cases + link to new issue/s)
sanity.system
extended.system
sanity.perf
extended.perf

The table could be extended with other columns if desired / appropriate e.g.

Ubuntu 24.04

Test suite JDK Arch Result ✅⚠️❌
sanity.openjdk 17 riscv64
extended.openjdk 17 riscv64 ❌ (New failing issue links)
sanity.openjdk 21 riscv64
extended.openjdk 21 riscv64 ❌ (New failing issue links)
sanity.openjdk 8 riscv64 ⚠️ (IssueLink1, Issuelink2)
extended.openjdk 8 riscv64 ❌ (New failing issue links)

sxa avatar Jun 14 '24 17:06 sxa