google-cloud-go icon indicating copy to clipboard operation
google-cloud-go copied to clipboard
verified publisher icon googleapis

bigtable: retry request on retryable error messages

Open bhshkh opened this issue 1 year ago • 3 comments

Client

Bigtable

Additional context

https://github.com/googleapis/google-cloud-go/pull/9673#discussion_r1567717162

Creating this issue to track the work of finding out if there are any Bigtable retryable error messages which are not been retried,

bhshkh avatar May 16 '24 21:05 bhshkh

Is it possible to retry Internal errors? I have a bunch of nightly tasks that sometimes fail due to this. Because we don't have access to the raw gRPC client there's nothing I can do but post here, or roll my own.

fsaintjacques avatar Aug 23 '24 18:08 fsaintjacques

@bhshkh ping

fsaintjacques avatar Sep 06 '24 14:09 fsaintjacques

Will pick this up soon.

bhshkh avatar Sep 28 '24 00:09 bhshkh

Any ETA @bhshkh

fsaintjacques avatar Nov 01 '24 14:11 fsaintjacques

Any update on this?

Yoshiji avatar Jan 17 '25 15:01 Yoshiji

@fsaintjacques Can you share the complete error message that you are seeing in the nightly?

bhshkh avatar Jan 21 '25 08:01 bhshkh

I have created the linked pull request to retry RST stream internal errors.

bhshkh avatar Jan 21 '25 08:01 bhshkh

We will try to capture one, but really this needs a gax.Retry on codes.Internal.

fsaintjacques avatar Jan 21 '25 13:01 fsaintjacques

gax.Invoke: t.table.ReadRows: rpc error: code = Internal desc = unexpected EOF

fsaintjacques avatar Jan 21 '25 14:01 fsaintjacques