Not all specs are running depending on seed

[ddieulivol]

The problem

The number of specs being run locally varies per run:

 $ bundle exec rspec                       

Randomized with seed 33336
[...]
Finished in 0.76282 seconds (files took 0.36278 seconds to load)
1155 examples, 0 failures

$ bundle exec rspec

Randomized with seed 24062
[...]
Finished in 0.69801 seconds (files took 0.36089 seconds to load)
1070 examples, 0 failures

$ bundle exec rspec

Randomized with seed 60919
[...]
Finished in 10.19 seconds (files took 0.35574 seconds to load)
132 examples, 0 failures

Using the same seed for RSpec gives the same number of specs:

 $ be rspec --seed 60919

Randomized with seed 60919
[...]
Finished in 10.18 seconds (files took 0.37901 seconds to load)
132 examples, 0 failures

It could be a spec exiting early? I haven't checked.

[NARKOZ]

Indeed specs are exiting early on running spec/gitlab/cli_spec.rb

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.