pranadb icon indicating copy to clipboard operation
pranadb copied to clipboard

Asynchronous drop data for source and MV

Open purplefox opened this issue 2 years ago • 0 comments

Currently drop source/mv doesn't complete until all data is dropped. And during that time the DDL lock is held so no other DDL can be executed.

This can take a considerable time if there is a lot of data in the table.

Instead we do the deleting of data from storage asynchronously after the drop has completed.

We should create a deletion manager which deletes the data with a rate limiter ensuring no more than X rows a second are deleted to prevent the IO from the deletion adversely affecting system performance.

purplefox avatar Jul 22 '22 15:07 purplefox