Local: Bad message format

[konlps]

We have Kafka configured on production server with topics created. Sometimes during the deploy when Kafka was down for a while some apps are not able to make query. The exception is 'Local: Bad message format' thrown by QueryWatermarkOffsets from .Net library (which executes Librdkafka.query_watermark_offsets method). After analysis the code of rdkafka.c it looks like in line 3461 or 3462 offset has no topic or partition, and in line 3487 error is returned.

We need answer: why topic or partition is lost? What could be wrong in our configuration or how to avoid this situation?

[emasab]

Hi @konlps, it can be that during deployment that broker is not the leader for that partition anymore. Does the problem disappear when the brokers have stabilized?

[nhaq-confluent]

Hey @konlps wanted to follow up to see if the previous comment has solved your issue