flares icon indicating copy to clipboard operation
flares copied to clipboard

Published 20 hours ago • verified publisher icon lfaoro

ERROR: More than 1200 requests per 300 seconds reached. Please wait and consider throttling your request speed

Open xyzulu opened this issue 2 years ago • 3 comments

Due to the number of domains I have now (I think near 400) I've started to see this error now. 300 seconds is quite a long time to run this script (flares).. I'm not sure what options there are now in this case.. any ideas?

xyzulu avatar Aug 18 '22 03:08 xyzulu

we need to investigate what could be optimized, or add throttling to the requests the program sends to match CF limits.

lfaoro avatar Aug 19 '22 14:08 lfaoro

https://developers.cloudflare.com/api/limits/ This is a hard limit. The only way that comes to mind now is to batch download say 100 zones each time flares runs. Then depending on the frequency you run flares (at least initially) you may need to wait some time before all zones are exported. The end result will still be an accurate export, it will just take longer.

xyzulu avatar Aug 20 '22 09:08 xyzulu

feel free to submit a pull request where the loop waits for the time.Sleep(time.Second * limit) once it reaches about 90% of the requests limit per second.

lfaoro avatar Sep 06 '22 15:09 lfaoro

stale

lfaoro avatar Sep 01 '23 08:09 lfaoro