infrastructure
infrastructure copied to clipboard
Add template for tests on new platform/distribution environments
As per https://github.com/adoptium/infrastructure/blob/master/FAQ.md#adding-new-systems we have a processs whereby new types of machines (New OS versions, new distributions etc.) Are run through an AQA_Test_Pipeline run.
It would be good if we had a standard template for logging the results of this e.g.
Key:
- ✅ - All test cases pass
- ⚠️ - Test suite had failures, but they are all covered by existing issues
- ❌ - New unexpected (or untracked) failures which are of concern as they may indicate issues with this combination
Ubuntu 24.04 / JDK17 / aarch64
Test suite | Result ✅⚠️❌ |
---|---|
sanity.functional | ✅ |
extended.functional | ✅ |
special.functional | ❌ (List of failing cases + link to new issue) |
sanity.openjdk | ⚠️ (IssueLink1, Issuelink2) |
extended.openjdk | ❌ (List of:failing cases + link to new issue/s) |
sanity.system | |
extended.system | |
sanity.perf | |
extended.perf |
The table could be extended with other columns if desired / appropriate e.g.
Ubuntu 24.04
Test suite | JDK | Arch | Result ✅⚠️❌ |
---|---|---|---|
sanity.openjdk | 17 | riscv64 | ✅ |
extended.openjdk | 17 | riscv64 | ❌ (New failing issue links) |
sanity.openjdk | 21 | riscv64 | ✅ |
extended.openjdk | 21 | riscv64 | ❌ (New failing issue links) |
sanity.openjdk | 8 | riscv64 | ⚠️ (IssueLink1, Issuelink2) |
extended.openjdk | 8 | riscv64 | ❌ (New failing issue links) |