pabot icon indicating copy to clipboard operation
pabot copied to clipboard

#WAIT is ignored if at EOF in ordering

Open dtthuynh opened this issue 4 years ago • 1 comments

If I want to specify certain testcases or testsuites to run first and then the rest of the testcases to run after (where order doesn't matter), I tried adding a #WAIT at the end of the ordering file but this hold isn't respected.

For example, if I had 10 testcases to run and used this ordering (where TCs 5-10 don't matter in terms of order):

--test Test Suite.Some Testcase 1
--test Test Suite.Some Testcase 2
#WAIT
--test Test Suite.Some Testcase 3
--test Test Suite.Some Testcase 4
#WAIT

In the above, the order I'm trying to achieve is:

  1. Run TC 1 & 2 first only
  2. After TC 1 & 2 are done, run only TC 3 & 4
  3. After TC 3-4 are done, run the remaining testcases 5-10 in whatever order.

What actually happens is this:

  1. Run TC 1 & 2 first only
  2. After TC 1 & 2 are done, pabot runs TCs 3-10 with the available processes.

The workaround to this I found is just to specify one of the testcases where the order doesn't matter:

--test Test Suite.Some Testcase 1
--test Test Suite.Some Testcase 2
#WAIT
--test Test Suite.Some Testcase 3
--test Test Suite.Some Testcase 4
#WAIT
--test Test Suite.Some Testcase 5

In this case it will actually wait until 3-4 are done and then run the remaining cases.

dtthuynh avatar Jul 23 '20 17:07 dtthuynh

Thanks for the issue report!

mkorpela avatar Jul 23 '20 19:07 mkorpela