monix-kafka icon indicating copy to clipboard operation
monix-kafka copied to clipboard

kafka 0.9.0 client offset error

Open goral09 opened this issue 7 years ago • 0 comments

Let me start with the output:

[2017-11-24 17:24:57,018] [DEBUG] [UpdatesService] [] Finished inserting 100 new record(s) into MetadataRepository.
[2017-11-24 17:24:58,149] [DEBUG] [UpdatesService] [] Finished inserting 100 new record(s) into MetadataRepository.
[2017-11-24 17:24:58,253] [ERROR] [o.a.k.c.c.i.ConsumerCoordinator] [] Error ILLEGAL_GENERATION occurred while committing offsets for group vies-metadata-listener
[2017-11-24 17:24:58,253] [WARN ] [o.a.k.c.c.i.ConsumerCoordinator] [] Auto offset commit failed: Commit cannot be completed due to group rebalance
[2017-11-24 17:24:58,254] [ERROR] [o.a.k.c.c.i.ConsumerCoordinator] [] Error ILLEGAL_GENERATION occurred while committing offsets for group vies-metadata-listener
[2017-11-24 17:24:58,254] [WARN ] [o.a.k.c.c.i.ConsumerCoordinator] [] Auto offset commit failed: 
[2017-11-24 17:24:59,537] [DEBUG] [UpdatesService] [] Finished inserting 100 new record(s) into MetadataRepository.
[2017-11-24 17:25:00,655] [DEBUG] [UpdatesService] [] Finished inserting 100 new record(s) into MetadataRepository.
[2017-11-24 17:25:01,780] [DEBUG] [UpdatesService] [] Finished inserting 100 new record(s) into MetadataRepository.

Even though I am not spending seconds between consecutive polls I am seeing ILLEGAL_GENERATION error which according to Internet gurus is thrown when kafka consumer group rebalances while I am spending time between polls.

goral09 avatar Nov 24 '17 16:11 goral09