osdfir-infrastructure icon indicating copy to clipboard operation
osdfir-infrastructure copied to clipboard

Github rate limit hit pulling Turbinia releases information

Open hacktobeer opened this issue 6 months ago • 3 comments

Name and Version

charts/turbinia 1.1.1

What environment are you using?

Minikube

What steps will reproduce the bug?

Helm deploy Turbinia and spinup a heavy processing job that start many workers. Each worker will try to pull from api.github.com here https://github.com/google/osdfir-infrastructure/blob/main/charts/turbinia/templates/init-configmap.yaml#L29

As the rate limit for unauthenticated users is 60 requests per hour it will prevent containers from pulling the Turbinia configuration file once that limit is hit (as it can't resolve the release version through the github api call). https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api?apiVersion=2022-11-28#primary-rate-limit-for-unauthenticated-users

Are you using any custom parameters or values?

No

What is the expected behavior?

To not fail the release github api call and succesful download of the turbinia configuration template file.

What do you see instead?

wget: server returned error: HTTP/1.1 403 rate limit exceeded

Additional information

No response

hacktobeer avatar Aug 08 '24 16:08 hacktobeer