parallel_stream icon indicating copy to clipboard operation
parallel_stream copied to clipboard

Better documentation on `num_workers`, `worker_work_ratio`

Open ben-pr-p opened this issue 8 years ago • 4 comments

Hi!

Thanks for the library!

Could you write up some documentation on how those options work for ParallelStream.map?

My intuition says that as long as num_workers: 1, it's effectively not parallel, and worker_work_ratio is for managing the batch size passed to each worker for fine tuning acceptable parallel overhead?

ben-pr-p avatar Aug 28 '17 17:08 ben-pr-p

Yes you're right with your assumptions as well as the assertion that these could be documented better.

beatrichartz avatar Mar 03 '19 05:03 beatrichartz

Could I take this as a first-time open source contribution?

Jdcorley avatar Mar 05 '19 16:03 Jdcorley

@Jdcorley absolutely, have at it!

beatrichartz avatar Mar 08 '19 05:03 beatrichartz