Jon Howell
Jon Howell
Maybe a better script would count up to some total length, since the import process seems to die due to overall memory allocation.
@hartmark good point on cleaning up the mess after. I haven't actually finished *running* the script over here yet. :v) My first chunk is 1M records. It completed the `bundle`...
Oh shame on me, this topic is [covered in the faq](https://dawarich.app/docs/FAQ). I tried making 4 extra sidekiq containers, and now it looks like importing 1M records will take about a...
Here's a better version of my splitter script for enormous Google Takeout Records.json files. The main improvement is that it parses the input incrementally so this script itself doesn't encounter...
@melroy89 Thank you! That worked instantly, as advertised. I've been wanting this feature forever!