aleph icon indicating copy to clipboard operation
aleph copied to clipboard

Published 20 hours ago • verified publisher icon alephdata

Implement rate limits on writes to blob storage

Open sunu opened this issue 4 years ago • 4 comments

While processing large PST files and other archives on Aleph. we hit the GCS rate limit some times while writing files to our storage bucket.

We should enforce a configurable rate limit when writing files to the archive.

sunu avatar Sep 23 '21 07:09 sunu