benchbase icon indicating copy to clipboard operation
benchbase copied to clipboard
verified publisher icon cmu-db

Tpch load retries

Open dbanda opened this issue 3 years ago • 2 comments

In our testing with TPCH we found that for large scale factors the loader wasn't fault tolerant and would have to be restarted after any connectivity failure. In this PR we implement a retry mechanism where the loader retries batches a few times after failure. This was very helpful in cases where we had very high scale factor and there was intermittent connectivity. It's quite a big PR so feedback on how I can package it better is greatly appreciated.

dbanda avatar May 23 '22 21:05 dbanda

Thanks for sending this. We will take a look at it later this week.

apavlo avatar May 24 '22 21:05 apavlo

@dbanda Any update?

apavlo avatar Jun 21 '22 13:06 apavlo