prune-dist-git causes huge Frontend API traffic

Open praiskup opened this issue 1 year ago • 2 comments

Optimize-out the large API (daily in Fedora Copr) caused by: https://github.com/fedora-copr/copr/blob/main/dist-git/run/prune-dist-git.py

Currently it causes 30k API calls daily.

Apr 09 '24 15:04 praiskup

Proposal: Let's have a /backend/active-dirs/ route (can require FE token authentication to avoid DoSing by non-distgit users) providing a list of all CoprDirs (that's a relatively cheap query, <= 50k directories now, <= 5MB of data).

Apr 09 '24 15:04 praiskup

Currently 28656 API calls:

# wc -l /var/log/copr-dist-git/api-calls-2024-04-09.log 
28656 /var/log/copr-dist-git/api-calls-2024-04-09.log

Apr 09 '24 16:04 praiskup