hyades icon indicating copy to clipboard operation
hyades copied to clipboard

Look into handling unavailable kafka service/ broker

Open mehab opened this issue 2 years ago • 2 comments

If for some reason, the topics that the application wants to send data to are temporarily unavailable then the application should be able to hold on to the events for a certain time and retry like a polling mechanism until the topics are available again. This would help in stopping any events being lost due to unavailability of service.

mehab avatar Feb 01 '23 18:02 mehab

I think this should be covered by the Kafka clients automatically, see https://www.conduktor.io/kafka/kafka-producer-retries and #70 (section "Producers").

Granted, we'll probably need to tweak and verify the configuration.

nscuro avatar Feb 01 '23 18:02 nscuro

ToDo: Provide some sane defaults (e.g. reducing retry attempts to something less than MAX).

nscuro avatar Feb 03 '23 17:02 nscuro

Not pursuing this anymore as a consequence of #1619

nscuro avatar Jan 11 '25 19:01 nscuro