aria-at icon indicating copy to clipboard operation
aria-at copied to clipboard

Support test plans that specify a command assertion exception for an assertion that is not listed in tests.csv

Open mcking65 opened this issue 2 years ago • 1 comments

This is a test writing simplification proposal raised in the description of #1039 that we agreed not to implement in #1042.

If the author of a test plan wants to add one or more assertions to a subset of commands that are assigned to a test, and if the author wants those assertions to be at the end of the sequence of assertions, then support specifying one or more assertions in the assertionExceptions column of *-commands.csv without specifying those assertions as 0 priority assertions in tests.csv. Thus, the list of assertions that are included for a command includes:

  1. All assertions listed in tests.csv in the order listed in tests.csv that have a non-0 priority in both tests.csv and commands.csv.
  2. All the assertions listed for the command in commands.csv in the order listed in commands.csv where:
    1. Are not present in tests.csv
    2. Have a non-0 priority in commands.csv

mcking65 avatar Mar 11 '24 00:03 mcking65

Adding context, last time we went over this @mcking65 mentioned he will discuss with Isabel and confirm whether we would implement it. Bocoup's recommendation was not to move forward with it.

ccanash avatar Aug 28 '24 19:08 ccanash