aqa-test-tools
aqa-test-tools copied to clipboard
adoptium
Home of Test Results Summary Service (TRSS) and PerfNext. These tools are designed to improve our ability to monitor and triage tests at the Adoptium project. The code is generic enough that it is e...
**Summary** In a deeply unusual extended.perf run, several failed test targets are identified by TRSS as "disabled", and several more are identified as "failed" when they actually passed. https://trss.adoptopenjdk.net/allTestsInfo?buildId=60735c4947db975731f280c2&limit=5&hasChildren=false **Details**...
We would like to be able to run tests in many different CI environments (to encourage testing 'everywhere' and to leverage resources at our disposal, https://dev.azure.com/adoptopenjdk). This issue is an...
As TRSS stores more and more data, we noticed MongoError: $graphLookup reached maximum memory consumption ``` MongoError: $graphLookup reached maximum memory consumption at MessageStream.messageHandler (/home/testci/openjdk-test-tools/TestResultSummaryService/node_modules/mongodb/lib/cmap/connection.js:268:20) at MessageStream.emit (events.js:198:13) at processIncomingData...
We should create PR build for TRSS to do the basic checks. GitHub workflow can be used for creating PR build. Two possible ways for setting up the environment: -...
Related to adding time-based system tests, we will want to run variations of these time-based tests to determine / visualize / tune optimal amount of time required that may cause...
Related to https://github.com/AdoptOpenJDK/openjdk-tests/issues/2037, create a widget that can display the various average execution times of test targets. The tables in https://github.com/AdoptOpenJDK/openjdk-tests/issues/2037 were manually created based on querying TRSS API, we...
I think we can rename and repurpose the FVT tab to a Custom tab, and make it a space where we can create a new Test Metrics and Stats widget...
I'd like to check the latest third party builds' status by jdk version. The thing is the combination of date and jdk doesn't work. We can only sort either by...
According to https://github.com/AdoptOpenJDK/openjdk-build/issues/1476, we can get openjdk sha from the release file. TRSS should capture this information, store it in database, and display it in UI in the tooltip. Example:...
We see that currently on Perf Compare (TRSS) the regression percentage for SUFP is being calculated by dividing the baseline result by the test result (above 100% is an improvement)....
