off_broadway_kafka
off_broadway_kafka copied to clipboard
Read many topics
Hi I'm trying to read three topics from Kafka, I'm using this configuration
kafka_config = [
connection: :hclient,
endpoints: [localhost: 9092],
group_consumer: [
group: "hurricane",
topics: [address, customer, email],
config: [
begin_offset: :earliest
]
]
]
Broadway.start_link(__MODULE__,
name: __MODULE__,
producers: [
default: [
module: {OffBroadway.Kafka.Producer, kafka_config}
]
],
processors: [
default: [stages: 1]
]
)
but return duplication_child_name error
** (Mix) Could not start application hurricane: Hurricane.Application.start(:normal, []) returned an error: shutdown: failed to start child: Hurricane.KafkaConsumer.Pdw ** (EXIT) an exception was raised: ** (MatchError) no match of right hand side value: {:error, {:shutdown, {:failed_to_start_child, #Reference<0.846987210.1907359748.66839>, {:shutdown, {:failed_to_start_child, Hurricane.KafkaConsumer.Pdw.Broadway.Producer_default_1, {:shutdown, {:failed_to_start_child, Elsa.Group.Supervisor, {:start_spec, {:duplicate_child_name, Elsa.Group.ConsumerSupervisor}}}}}}}}} (broadway) lib/broadway/server.ex:16: Broadway.Server.init/1 (stdlib) gen_server.erl:374: :gen_server.init_it/2 (stdlib) gen_server.erl:342: :gen_server.init_it/6 (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3