off_broadway_kafka icon indicating copy to clipboard operation
off_broadway_kafka copied to clipboard

Read many topics

Open zerobatu opened this issue 4 years ago • 1 comments

Hi I'm trying to read three topics from Kafka, I'm using this configuration

kafka_config = [
  connection: :hclient,
  endpoints: [localhost: 9092],
  group_consumer: [
    group: "hurricane",
    topics: [address, customer, email],
    config: [
      begin_offset: :earliest
    ]
  ]
]
Broadway.start_link(__MODULE__,
  name: __MODULE__,
  producers: [
    default: [
      module: {OffBroadway.Kafka.Producer, kafka_config}
    ]
  ],
  processors: [
    default: [stages: 1]
  ]
)

but return duplication_child_name error

** (Mix) Could not start application hurricane: Hurricane.Application.start(:normal, []) returned an error: shutdown: failed to start child: Hurricane.KafkaConsumer.Pdw ** (EXIT) an exception was raised: ** (MatchError) no match of right hand side value: {:error, {:shutdown, {:failed_to_start_child, #Reference<0.846987210.1907359748.66839>, {:shutdown, {:failed_to_start_child, Hurricane.KafkaConsumer.Pdw.Broadway.Producer_default_1, {:shutdown, {:failed_to_start_child, Elsa.Group.Supervisor, {:start_spec, {:duplicate_child_name, Elsa.Group.ConsumerSupervisor}}}}}}}}} (broadway) lib/broadway/server.ex:16: Broadway.Server.init/1 (stdlib) gen_server.erl:374: :gen_server.init_it/2 (stdlib) gen_server.erl:342: :gen_server.init_it/6 (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3

zerobatu avatar Oct 16 '19 14:10 zerobatu