readstat-rs
readstat-rs copied to clipboard
Channel capacity
Research how want to handle channel capacity to help keep memory down when running with --parallel option
Consider the following - an example of a streaming data pipeline with back pressure that does not rely on channel capacity:
https://medium.com/@polyglot_factotum/rust-concurrency-a-streaming-workflow-served-with-a-side-of-back-pressure-955bdf0266b5