bandcamp-collection-downloader icon indicating copy to clipboard operation
bandcamp-collection-downloader copied to clipboard

Bandamp rate limiting causing files not to download

Open demize opened this issue 3 years ago • 5 comments

Bandcamp appears to have implemented some sort of aggressive rate limiting on their end that causes problems with bandcamp-collection-downloader; after a few releases are downloaded, Bandcamp starts returning 429 Too Many Requests instead of files, and the downloads fail.

The most effective way of combating this may be to implement exponential backoff on 429 errors such that all albums end up downloaded without making Bandcamp too angry; as it is, large portions of your library fail to download because the current retry method is too quick.

demize avatar Jan 20 '22 18:01 demize

Any traction on this? Running into it now as well

roxaloxa avatar Feb 05 '22 04:02 roxaloxa

Thanks for the report. Indeed that's an issue. I haven't encountered it yet, but I should run some tests to see if I can reproduce it.

If anyone wants to try a fix, PRs are of course welcome − I don't know when I will have time to make the fix :/

Ezwen avatar Feb 06 '22 09:02 Ezwen

@Ezwen I always hit it somewhere around 20 downloads, everything after failed with code 429. I just kept running the script until my entire collection synced, and now I doubt I'll ever hit it again as I likely won't buy more than 20 albums at once haha. So it's weird in that it shouldn't happen often... but likely guaranteed to happen immediately on first time use?

roxaloxa avatar Feb 07 '22 04:02 roxaloxa

Hello, I have installed the program earlier today, seeing this issue I have set the number of jobs to 1, I'm at download N° 118 without problems so far

FabioLolix avatar Feb 13 '22 22:02 FabioLolix