Run-rerun on version 3

[ipapagia]

After upgrading to 3.0.1, I am trying to use the command run-rerun introduced in 2.4.

The functionality is not available.

$ npx codeceptjs run-rerun

Unknown command run-rerun

Details

• CodeceptJS version: 3.0.1
• NodeJS Version:
• Operating System:
• puppeteer || webdriverio || protractor || testcafe version (if related)
• Configuration file:

# paste config here

[artvinn]

Same issue here.

I see that run-rerun definition is present in master branch https://github.com/codeceptjs/CodeceptJS/blob/master/bin/codecept.js#L122-L157

But it's missing in 3.x, from what latest releases are made. It was removed with this commit https://github.com/codeceptjs/CodeceptJS/commit/03c5c910272b8a2cd2aefe29d279c35511c97856#diff-dbf7fdf7b53c931c00e8c6103a0f8843d92161657ae66613f6659415f9ac85d8 by @DavertMik

@DavertMik was it intentional? :) Can I PR to put it back?

[manciukass]

Yep, can confirm as well, would be great to have this feature back :) it was really go to find flakiness :)

[hammadebot]

facing the same problem myself, should we revert to the old version to support it?

[mirao]

It's still in docs: https://codecept.io/commands/#run-rerun , so I guess that feature was not removed intentionally.

[danielrentz]

Any chance to get a response from the authors of the aforementioned commit? @DavertMik @pablopaul

[jancorvus]

Voting for this feature back

[Tir0ck]

Hi, I just wanna up this topic, because it still actual

[eduardofinotti-james]

when will it come back? Anybody know? :)

[khushal-sahni]

I would also like to know when is it coming back, my project needs to deal with some flaky tests

[AllysonYuShiong]

@PeterNgTr this feature is very much needed. Can someone help in this matter?

[stracker-phil]

I see that there are still parts of the rerun code left in the current 3.x branch. Maybe it's possible to integrate the rerun config into the standard run command: When rerun: {} config is present, it will be used. Otherwise, the test runs once.

[VinnyIla]

I am also facing the same issue. Any chance to get this feature back.

[jimpriest]

@DavertMik Just ran into this myself with v3.2.2 - been almost a year with no reply or fix?

[DavertMik]

Sorry, no one has implemented this command yet

[jimpriest]

I see. Should I remove it from the docs? According to comments above and in the docs it was in 2.4 but removed from 3?

[mc-alt]

After spending a good 30 minutes trying to work out what I was doing wrong, I strongly agree with removing it from the docs until the feature is re-added. There should also be a section about it in the breaking changes/migration notes

[cherrieg]

hi @dwentland24 , I have a question for re-run command, it is only run one by one , not like run-workers or run-multiple, right?

[mirao]

Just tested it with CodeceptJS 3.3.6 and it works as expected (in my case 2/25 runs failed). However when a last test iteration finishes, the CodeceptJS process isn't closed (even if I wait for long time) and I have to interrupt it over Ctrl + C. Is anybody seeing the same behavior?

$ codeceptjs run-rerun PlayDndGame_test.ts --profile jobr --debug
...
  OK  | 23 passed   // 1m

Process run 25 of max 25, success runs 23/25


Flaky tests detected! 23 success runs achieved instead of 25 success runs expected

Error: 
    at CodeceptRerunner.runTests (/home/mirao/workspace/codeceptjs/node_modules/codeceptjs/lib/rerun.js:60:13)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at async Command.module.exports (/home/mirao/workspace/codeceptjs/node_modules/codeceptjs/lib/command/run-rerun.js:31:5)

^C
$ 

my config:

rerun: {
    // how many times all tests should pass
    minSuccess: 25,
    // how many times to try to rerun all tests
    maxReruns: 25,
},

[MaticNezic]

Same issue as above, process wont finish on its own.