raider icon indicating copy to clipboard operation
raider copied to clipboard

Initial download of account with >10k images hits 'Rate limit' violation

Open Flatbeat opened this issue 4 years ago • 0 comments

Although the rate limit problem is solved for mass updating, it still exists when downloading big accounts initially. I suppose the problem is that Raider first fetches all pages and afterwards downloads images/videos. During this process I get the Rate limit warning when the count reaches something around 9 - 10k.

Maybe it is possible to implement something like a step size, similar to the 'Max posts' threshold? Raider then should fetch and download all posts up to this threshold (optionally sleeps for a certain amount of time) and then repeats the process for the next posts.

Flatbeat avatar Apr 28 '20 18:04 Flatbeat