developer-portal icon indicating copy to clipboard operation
developer-portal copied to clipboard

Published 20 hours ago • verified publisher icon mdn

Consider throttling invalidations

Open stevejalim opened this issue 5 years ago • 0 comments

If someone goes and publishes a lot of new content in rapid succession (eg approving auto-generated posts ingested from another Mozilla blog), then we can face CDN invalidation issues:

https://sentry.prod.mozaws.net/operations/developer-portal-stage/issues/7146814/?query=is:unresolved

TooManyInvalidationsInProgress `developerportal.apps.taskqueue.tasks.invalidate_entire_cdn An error occurred (TooManyInvalidationsInProgress) when calling the CreateInvalidation operation: Processing your request will cause you to exceed the maximum number of in-progress wildcard invalidations.

We need to think about this and ways to avoid triggering this situation.

stevejalim avatar Jan 24 '20 17:01 stevejalim