hatchet icon indicating copy to clipboard operation
hatchet copied to clipboard

Feature request: flush results for each 'page'

Open lury opened this issue 3 years ago • 2 comments

Hi,

I've noticed that process of downloading messages is split into 500 messages chunks. Could you add export flushes to csv, to have results for each 'page' of processed data without waiting for the whole process to finish?

Regards, Lury

lury avatar Jan 17 '22 09:01 lury

Yes, this is needed. I have over 614 thousand emails in my Gmail account and this will take forever to process all my emails. It would be great if it could flush the results after 500 messages have been processed.

AwesomeShare avatar Jan 17 '22 17:01 AwesomeShare

This is a great idea. I have almost 400k emails in my inbox, and I had to let it run overnight.

I'll need to think about the architecture of the state file, so this might take a bit to implement.

AnalogJ avatar Jan 20 '22 06:01 AnalogJ