kafka_ex icon indicating copy to clipboard operation
kafka_ex copied to clipboard

A down broker causes unnecessary restarts

Open dantswain opened this issue 8 years ago • 1 comments
trafficstars

If we have a three broker cluster in the config, but one of those brokers is down, the application appears to continually crash and restart. The cluster is set up properly to handle the down broker and other (non-KafkaEx) services appear to adapt to this just fine.

Removing the downed broker from the config list resolves the problem. I.e., this is not a problem with the way the client runs but a problem with how it is dealing with potentially out-of-date configuration.

dantswain avatar Nov 13 '17 21:11 dantswain

I haven't observed this in a while - I believe the heartbeating is now catching this and refreshing the metadata if a broker is actually down (not just temporarily unreachable). If a broker is unreachable, kafkaex will still attempt to connect to it because that's where the metadata points it for some partitions. I think this can be closed?

joshuawscott avatar May 02 '20 23:05 joshuawscott

Tested it and it works with heartbeats functionality.

Argonus avatar Mar 07 '24 13:03 Argonus