aqa-tests
aqa-tests copied to clipboard
WIP: Documenting intermittently failing tests in perf and system
Split off from https://github.com/adoptium/aqa-tests/pull/6472
- [x] Task 1: Create these lists.
- [ ] Task 2: Convert them into playlist xml format
- [ ] Task 3: Find a way to exclude these tests at runtime, but only for releases.
Before spending time on this, I'd like to spend some time thinking how best to achieve the end goal.
One thing I want to consider is to add a new feature in TKG, a tag element in the playlist xsd file to allow existing playlists to be updated with a note, and passing TKG an option to ignore/annotate or exclude. In this way we do not create a new playlist, we edit existing playlists and update TKG to behave in a certain way based on a new tag within the <test> element.