aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

WIP: Documenting intermittently failing tests in perf and system

Open adamfarley opened this issue 3 months ago • 1 comments

Split off from https://github.com/adoptium/aqa-tests/pull/6472

  • [x] Task 1: Create these lists.
  • [ ] Task 2: Convert them into playlist xml format
  • [ ] Task 3: Find a way to exclude these tests at runtime, but only for releases.

adamfarley avatar Sep 10 '25 14:09 adamfarley

Before spending time on this, I'd like to spend some time thinking how best to achieve the end goal.

One thing I want to consider is to add a new feature in TKG, a tag element in the playlist xsd file to allow existing playlists to be updated with a note, and passing TKG an option to ignore/annotate or exclude. In this way we do not create a new playlist, we edit existing playlists and update TKG to behave in a certain way based on a new tag within the <test> element.

smlambert avatar Sep 10 '25 14:09 smlambert