Handle push requests from the last mini-batch

[wynot12]

Since push requests are done asynchronous, we cannot know when these requests are completed. This can be a problem when we wanna delete/checkpoint a table after the push requests completes.