Crash in case of huge pile

Open bmaz opened this issue 3 years ago • 1 comments

Should we avoid loading the pile if the file is too big?

Dec 13 '22 13:12 bmaz

Too big stack files could be solved by saving them by packets of say 50,000 tweets and unpacking them at reload one by one before launching the collections

Dec 16 '22 09:12 bmaz