Kafka plugin: Make the group ID configurable

Open hariso opened this issue 3 years ago • 1 comments

Feature description

@ahmeroxa mentioned that some Kafka deployments will use fixed consumer groups (e.g. DevOps will explicitly create Groups with certain ACLs etc.), so we need to make the group ID configurable.

This will enable some valuable use cases such as scaling via multiple Conduit instances as well as recovery (where I can create a new instance and have it continue where the previous consumer ended).

Jan 28 '22 16:01 hariso

@neovintage Should we move this into https://github.com/ConduitIO/conduit-connector-kafka?

Sep 13 '22 19:09 hariso

Done in https://github.com/ConduitIO/conduit-connector-kafka/pull/48.

Sep 23 '22 15:09 hariso