aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

EPIC: Enable a Disabled tests pipeline or workflow

Open smlambert opened this issue 5 years ago • 9 comments

This test pipeline could check state of the issue that the test was disabled under and then run all disabled test targets whose issues are resolved to check if they really are in a state to reinclude/reenable.

Since there are various granularities on how we can and do disable tests, this work would look at several parts:

  • [x] disabled test targets in playlists
  • [ ] disabled openjdk tests in openjdk subdirectory (in problemlist*.txt files)
  • [ ] disabled functional tests in openj9 repo (several types of exclusions, testNG, cmdlinetester, others?) - optional for 1st version of this feature
  • [x] https://github.com/adoptium/aqa-tests/issues/3917 (check when the playlists are changed and report if there are any exclusions that should be assessed, or any parsing issues with the playlist)

Update from comment below where there are several subtasks as part of this EPIC:

  • #2698
  • #2699
  • #2701
  • #2702

We have many pieces of this EPIC completed, and now it is time to integrate the pieces into a single working pipeline.

smlambert avatar Jun 26 '20 13:06 smlambert