librdkafka icon indicating copy to clipboard operation
librdkafka copied to clipboard

The connection from producer to Kafka cluster is flapping

Open mukulksrivastava opened this issue 7 months ago • 0 comments

The Kafka is deployed in a kubernetes environment with 3 pods in a kafka cluster.

The producer kafka connection keeps flapping. The error callback is producing below low -

**err: Local: Broker transport failure

reason: kafka-0.kafka-headless.common.svc.cluster.local:9092/1001: Receive failed: Disconnected**

What is the reason for this flap?

I have below config set, but i am not getting any additional information.

rd_kafka_conf_set(conf, "debug", "broker,topic,msg", NULL, 0); rd_kafka_conf_set(conf, "log_level", "7", NULL, 0);

Other config:

rd_kafka_conf_set(conf, "socket.keepalive.enable", "true", NULL, 0); rd_kafka_conf_set(conf, "log.connection.close", "true",NULL, 0);

mukulksrivastava avatar Mar 21 '25 20:03 mukulksrivastava