readstat-rs icon indicating copy to clipboard operation
readstat-rs copied to clipboard

Channel capacity

Open curtisalexander opened this issue 3 years ago • 1 comments

Research how want to handle channel capacity to help keep memory down when running with --parallel option

curtisalexander avatar Aug 24 '22 17:08 curtisalexander

Consider the following - an example of a streaming data pipeline with back pressure that does not rely on channel capacity:

https://medium.com/@polyglot_factotum/rust-concurrency-a-streaming-workflow-served-with-a-side-of-back-pressure-955bdf0266b5

curtisalexander avatar Sep 12 '22 07:09 curtisalexander