pqdm icon indicating copy to clipboard operation
pqdm copied to clipboard

Feature Request: return iterable instead of list

Open tjyuyao opened this issue 1 year ago • 1 comments

  • Parallel TQDM version: 0.2.0

Description

I need to post-process the results returned by pqdm(). The number of tasks is very large, so it is not acceptable to store all the results in the memory. Is it possible to return an iterable, instead of a list, so I can consume the results on the fly? In this case, pqdm pre-fetch a number of results instead of produce as quick as possible to keep the memory usage constant.

tjyuyao avatar Mar 30 '23 10:03 tjyuyao