watermill icon indicating copy to clipboard operation
watermill copied to clipboard

Published 20 hours ago • verified publisher icon ThreeDotsLabs

[watermill-kafka] "read tcp <ip>:<port>: i/o timeout" when kafka rebalances

Open zaidoon1 opened this issue 1 year ago • 2 comments

This appears to be the same issue as https://github.com/Shopify/sarama/issues/1192? And it can be fixed by doing something like https://github.com/IBM/sarama/commit/0151486eeb29f538508f313a3c4f9c1c11ee5e04 ?

zaidoon1 avatar Aug 10 '23 02:08 zaidoon1

This seems like it could help. Using select vs ranging the channel here feels like the right thing to do too. I am not sure I know kafka well enough to reproduce reliably but can make the change and open a PR if tests pass.

AlexCuse avatar Sep 03 '23 13:09 AlexCuse

Tried making this change and seeing some failures in tests - appear to be related to nil messages coming through the channel.

AlexCuse avatar Sep 03 '23 22:09 AlexCuse