leofs icon indicating copy to clipboard operation
leofs copied to clipboard

[leo_gateway] Abort Multi-part Upload (MU) requests can cause high load on all leo_storage(s)

Open mocchira opened this issue 7 years ago • 0 comments

Now Abort MU(AMU) issues listing (prefix search) objects internally to fetch records to be deleted and this listing happens across all metadata stores (leveldb) so this can cause high load on all leo_storage(s) especially when there are many metadata stores (num_of_containers is set to very large). Instead we should implement AMU by referring cnumber in metadata and issues only HEAD against objects that can be existing.

mocchira avatar Oct 25 '17 02:10 mocchira