[Question] Rate-limiting functionality for requests?

[teward]

In trying to add a source locally, I keep hitting rate limits that it seems Imgbrd-grabber is incapable of handling. I've had to write separate API code and use a completely separate program to process my queries for that source in order to properly adhere to the rate limits with proper backoff.

Are there any mechanisms in imgbrd-grabber to enact ratelimit controls and handling for error code responses for certain sources? If not, can we consider this? (Derpibooru for instance has rate limits but it seems that the system has inbuilt code to handle that or hide it).

[suminohana]

would be a good idea to set a cooldown between each download, and to set a maximum bandwidth per site per hour. this should avoid ratelimits and ipbans.