rubycritic icon indicating copy to clipboard operation
rubycritic copied to clipboard

Option to run analysers in parallel

Open jbodah opened this issue 9 years ago • 3 comments

Running the analysers in a large project can take far too long (over an hour on legacy system). One easy way to speed things up is to do a map-reduce using multiple processes. I had done some initial investigation into this but was blocked by https://github.com/whitesmith/rubycritic/issues/90. My working spike for this is here https://github.com/jbodah/rubycritic/tree/parallel

jbodah avatar Feb 03 '16 04:02 jbodah

Alternatively it might be easier to instead slice groups of files and run each of those slices through the full analyser pipeline in parallel than it would be to parallelize each analyser run

jbodah avatar Feb 03 '16 05:02 jbodah

One hour? Would love to see this bad boy ;)

Alternatively it might be easier to instead slice groups of files and run each of those slices through the full analyser pipeline in parallel than it would be to parallelize each analyser run

Ack. Keep in mind though that we will probably make Reek 283% more awesome by reading in the whole source tree with one slurp (right now its file based) . But thats probably quite some time ahead ;)

troessner avatar Feb 03 '16 08:02 troessner

Addendum: One of many reasons for this

Keep in mind though that we will probably make Reek 283% more awesome by reading in the whole source tree with one slurp (right now its file based) .

you can find e.g. here

troessner avatar Feb 03 '16 09:02 troessner