Add a 'Retry' Status

[stephenrafferty3]

Is your feature request related to a problem? Please describe. As we are running are cucumber scenarios using wdioParallel, each of our features are split into their own scenarios, therefor for the retrying of failing tests we make use of the specFileRetries option in the config file.

This means that when a single test is retried, it is then added as an additional test instead. The report the shows the test as 2 failing tests rather than the preferred 1 failing test and 1 retried test.

Describe the solution you'd like I would like a way for the report to group the retried tests together showing that the test has failed and has retried x number of times. (if if we are allowing 2 retry attempts and the test passes on the second attempt, we would like to see the failed attempts before the passing attempt.)

Describe alternatives you've considered I have tried overwriting the the result status, but this doesnt fixing the skewing test numbers where retries are being counted as additional tests.

Additional context

this image shows my example, of 2 tests running, 1 passing and 1 failing with 2 retry attempts (i have overwritten the status to be ambiguous to try and differentiate the retry attempts) But it is still appears as 4 test being executed vs just the desired 2.

[wswebcreation]

Hi @stephenrafferty3

Any change that you can share a sample output from the wdioParallel service that you are referring to? That would help in understanding the issue

[stephenrafferty3]

the main part of the output im referring to is result":{"status":"failed"}, a status type of "retry", which is not counted towards the total number of unique tests would solve this issue.

Is that the output information you require?

[wswebcreation]

Not sure what you mean, can you elaborate it a bit more what you want / expect?

[cgarzon11]

I think that this issue is related to https://github.com/WasiqB/multiple-cucumber-html-reporter/issues/221