Ryan Barrett
Ryan Barrett
Maybe obsoleted by #830 🤞
...nope, turns out #830 probably won't work after all, so this issue definitely still applies.
The 10k limit in Google Cloud DNS is a quota, `rrsetsPerManagedZone`, that I can request an increase for. May try that. * https://cloud.google.com/dns/quotas#quotas * https://console.cloud.google.com/iam-admin/quotas?service=dns.googleapis.com&metric=dns.googleapis.com%2Fquota%rrsets_per_managed_zone&project=brid-gy
Tried requesting a quota bump. 🤞
In unrelated very good news, @bnewbold built us a whole new microservice to solve this! https://github.com/bluesky-social/atproto/discussions/1697#discussioncomment-9308726 . Extremely generous of him. Thank you Bryan!!!
More good news, I asked for a GCP DNS quota bump to 50k and got it. Woo!
We're currently at 6500 DNS records, with the limit still at 50k. We'll (hopefully) still need to figure this out eventually, but it seems like we have plenty of time.
Probably yes, cachetools in memory, since it would be separate for each incoming HTTP request, no need to use a separate unified memory cache.
Actually https://requests-cache.readthedocs.io/ looks perfect for this!
This would also be a good opportunity to start using a request-local `requests.Session` to pipeline/reuse connections per server.