pranadb
pranadb copied to clipboard
Asynchronous drop data for source and MV
Currently drop source/mv doesn't complete until all data is dropped. And during that time the DDL lock is held so no other DDL can be executed.
This can take a considerable time if there is a lot of data in the table.
Instead we do the deleting of data from storage asynchronously after the drop has completed.
We should create a deletion manager which deletes the data with a rate limiter ensuring no more than X rows a second are deleted to prevent the IO from the deletion adversely affecting system performance.