ruby-kafka icon indicating copy to clipboard operation
ruby-kafka copied to clipboard

Consider rebalance_timeout on join request

Open abicky opened this issue 3 years ago • 0 comments

This PR resolves https://github.com/zendesk/ruby-kafka/issues/941.

As the coordinator waits for each member to rejoin when rebalancing the group, the timeout of join request should be greater than rebalance_timeout.

rebalance_timeout_ms : The maximum time in milliseconds that the coordinator will wait for each member to rejoin when rebalancing the group.

cf. https://kafka.apache.org/protocol.html#The_Messages_JoinGroup

Otherwise, each member might send join requests over and over, and as a result, the following problems occur:

  • Some partitions are never processed until session_timeout passes
  • It takes much time for rebalance that occurs in a short time to finish

abicky avatar May 17 '22 21:05 abicky