[Feature] Selectively disable individual tests

[chipzoller]

What would you like to be added:

A method for selectively disabling one test, perhaps by prefixing the folder name with a reserved character or string, which does not require moving the folder or changing any of the files within it.

Why is this needed:

In complex projects with a complex directory hierarchy, there are cases where tests need to be disabled but only temporarily. For example, when a bug in the software has been identified but is being worked on, the test which exposed said bug needs to not be tested until that bug is fixed. To do so would mean all subsequent runs will fail. If these tests are being run in a CI pipeline for every PR, this will create an enormous amount of failures stunting project progress. Selectively disabling one or more tests in situ will allow the remainder to work as intended.

[iblancasa]

Probably that could be part of KEP-06, adding a new annotation or something to disable the tests under desired conditions

[chipzoller]

The KEP is over two years old.

[iblancasa]

@chipzoller and..? It is not invalid

[eddycharly]

@chipzoller @iblancasa @kensipe how about doing this https://github.com/kudobuilder/kuttl/pull/406 ?

[chipzoller]

I support this.