pqdm
pqdm copied to clipboard
Feature Request: return iterable instead of list
- Parallel TQDM version: 0.2.0
Description
I need to post-process the results returned by pqdm(). The number of tasks is very large, so it is not acceptable to store all the results in the memory. Is it possible to return an iterable, instead of a list, so I can consume the results on the fly? In this case, pqdm pre-fetch a number of results instead of produce as quick as possible to keep the memory usage constant.