flink-http-connector icon indicating copy to clipboard operation
flink-http-connector copied to clipboard

HTTP lookup source max retries

Open Raz0r opened this issue 1 year ago • 2 comments

Description

Lookup queries are now retried in case of IOException up to gid.connector.http.source.lookup.max-retries with a delay of gid.connector.http.source.lookup.request.retry-timeout-ms between retries. The default values are 3 retries and 1 second delay.

Resolves https://github.com/getindata/flink-http-connector/issues/66

PR Checklist
  • [x] Tests added
  • [x] Changelog updated

Raz0r avatar Apr 23 '24 07:04 Raz0r

Hey @davidradl thanks, didn't know about existing AsyncRetryStrategies, I will need some time to figure out how to use it correctly with making IOException bubble up.

Raz0r avatar May 06 '24 08:05 Raz0r

@Raz0r See https://github.com/getindata/flink-http-connector/pull/94. As part of introducing caching there is a max-retries option that can be used

davidradl avatar May 08 '24 16:05 davidradl

Closing this in favor of https://github.com/getindata/flink-http-connector/pull/129 and https://github.com/getindata/flink-http-connector/pull/120

Raz0r avatar Oct 25 '24 05:10 Raz0r