raider
raider copied to clipboard
Initial download of account with >10k images hits 'Rate limit' violation
Although the rate limit problem is solved for mass updating, it still exists when downloading big accounts initially. I suppose the problem is that Raider first fetches all pages and afterwards downloads images/videos. During this process I get the Rate limit warning when the count reaches something around 9 - 10k.
Maybe it is possible to implement something like a step size, similar to the 'Max posts' threshold? Raider then should fetch and download all posts up to this threshold (optionally sleeps for a certain amount of time) and then repeats the process for the next posts.