First runner process doesn't report (or is skipped entirely)

[swrobel]

I've noticed that the results seem to be short of my total suite number when I run with rspec, or parallel_tests, directly. Running in verbose mode, I've tracked it down to the first process, which doesn't seem to report its results (I'm unsure whether it's even running all of the tests).

I've done this by running in verbose mode, and comparing the number of specs run by the first runner with the number that are missing in my output - they always match, regardless of the number of processes I specify.

$ rake parallel:spec
...
87 examples, 0 failures
Took 139 seconds (2:19)

$ bundle exec turbo_tests -v
12 processes for 16 specs, ~ 1 specs per process
...
Finished in 2 minutes 16.4 seconds (files took 0 seconds to load)
68 examples, 0 failures

$ bundle exec turbo_tests -n 2
...
Finished in 39.83 seconds (files took 0 seconds to load)
34 examples, 0 failures

$ bundle exec turbo_tests -n 3
...
Finished in 44.92 seconds (files took 0 seconds to load)
64 examples, 0 failures

$ bundle exec turbo_tests -n 4
...
Finished in 49.09 seconds (files took 0 seconds to load)
69 examples, 0 failures

[ilyazub]

@swrobel, thanks for the bug report! Seems like it's more related to the reporting part.

I'll probably redo the IPC part of turbo_tests as it also complicates filtering groups for #2.

[ilyazub]

@swrobel It works on our codebase. Please provide an example setup that has this bug to help me find the cause of the bug.

$ bundle exec turbo_tests -n2 ./spec/search/yahoo/
2 processes for 14 specs, ~ 7 specs per process
....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Finished in 7.51 seconds (files took 0 seconds to load)
2484 examples, 0 failures

$ bundle exec turbo_tests -n3 ./spec/search/yahoo/
3 processes for 14 specs, ~ 4 specs per process
....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Finished in 6.53 seconds (files took 0 seconds to load)
2484 examples, 0 failures

$ bundle exec turbo_tests -n4 ./spec/search/yahoo/
4 processes for 14 specs, ~ 3 specs per process
....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Finished in 6.45 seconds (files took 0 seconds to load)
2484 examples, 0 failures

$ bundle exec turbo_tests -n5 ./spec/search/yahoo/
5 processes for 14 specs, ~ 2 specs per process
....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Finished in 7.09 seconds (files took 0 seconds to load)
2484 examples, 0 failures

$ bundle exec turbo_tests -v ./spec/search/yahoo/
8 processes for 14 specs, ~ 1 specs per process
Process 1: TEST_ENV_NUMBER=1 RSPEC_FORMATTER_OUTPUT_ID=7be379e6-cc97-42b4-8b2b-658e469d468d RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 10346 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/organic_results/organic_results_coffee_spec.rb
Process 2: TEST_ENV_NUMBER=2 RSPEC_FORMATTER_OUTPUT_ID=20d9fe66-05de-4968-b851-554a396f9421 RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 3959 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/domains_spec.rb
Process 3: TEST_ENV_NUMBER=3 RSPEC_FORMATTER_OUTPUT_ID=a071afd5-41ce-460f-8497-82fb45f2084f RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 47150 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/related_searches/related_searches_spec.rb
Process 4: TEST_ENV_NUMBER=4 RSPEC_FORMATTER_OUTPUT_ID=5dfb7433-f9d5-47b6-812e-7e2f485111ba RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 17860 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/organic_results/organic_results_coffee_mobile_spec.rb
Process 5: TEST_ENV_NUMBER=5 RSPEC_FORMATTER_OUTPUT_ID=182fa42b-4098-4b0b-984e-dde262d6ba3d RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 62152 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/local_pack/local_pack_desktop_spec.rb ./spec/search/yahoo/organic_results/organic_results_rich_snippet_spec.rb
Process 6: TEST_ENV_NUMBER=6 RSPEC_FORMATTER_OUTPUT_ID=c71442b3-ee53-4447-bb4a-75200b2e2bc4 RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 51756 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/local_pack/local_pack_mobile_spec.rb ./spec/search/yahoo/related_questions/related_questions_spec.rb
Process 7: TEST_ENV_NUMBER=7 RSPEC_FORMATTER_OUTPUT_ID=95a97dba-c4ff-4362-a4b8-b09bd97f0c2c RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 23095 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/empty_results_spec.rb ./spec/search/yahoo/parameters_spec.rb ./spec/search/yahoo/trending_now_searches/trending_searches_mobile_spec.rb
Process 8: TEST_ENV_NUMBER=8 RSPEC_FORMATTER_OUTPUT_ID=0c594ff4-a4f1-42ba-92b5-05d5f4a485af RUBYOPT=-I/home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/turbo_tests-1.2.0/lib /home/serpapi/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/bundler-2.1.4/libexec/bundle exec rspec --seed 18711 --format ParallelTests::RSpec::RuntimeLogger --out tmp/parallel_runtime_rspec.log --format TurboTests::JsonRowsFormatter ./spec/search/yahoo/organic_results/organic_results_rich_snippet_saved_html_spec.rb ./spec/search/yahoo/trending_now_searches/trending_searches_desktop_spec.rb ./spec/search/yahoo/validator_spec.rb
....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Finished in 9.68 seconds (files took 0 seconds to load)
2484 examples, 0 failures

[ilyazub]

We didn't reproduce it. turbo_tests and rspec executed the same number of examples.

bundle exec turbo_tests ./spec/search/yahoo/ 
3163 examples, 0 failures 

bundle exec rspec ./spec/search/yahoo/
3163 examples, 0 failures

@swrobel, feel free to share a repository with the reproducible example if the issue still exist.