delta-rs icon indicating copy to clipboard operation
delta-rs copied to clipboard

Retry every S3 request on 5xx server errors

Open mosyp opened this issue 2 years ago • 2 comments

The 5xx server errors for s3 have to be retried, however rusoto has no such feature. See discussion https://github.com/delta-io/delta-rs/pull/510#issuecomment-981887975 for more details.

mosyp avatar Nov 30 '21 12:11 mosyp

I think this can be closed now?

viirya avatar Dec 05 '21 08:12 viirya

@viirya i think this issue tracks the work to make the retry more robust. Right now the current retry logic is a busy loop without sleep and exponential backoff. We might want to apply the retry more generally to other S3 api calls as well.

houqp avatar Dec 07 '21 07:12 houqp