broadway_kafka
broadway_kafka copied to clipboard
dashbitco
A Broadway connector for Kafka
Hello! We have some issue with brod and broadway_kafka in kubernetes. When the service starts all consumers join to group and works fine. But after some time we got ```...
Hi all! 👋 First of all, thanks for the great libraries! We are running into a strange issue where every now and then (roughly once a day) we start seeing...
How can I configure kafka_broadway to stop once an error occurs? Once an error occurs, I would like to stop consuming messages and keep the same offset, this may be...
Team, I tried Broadway.stop(__ MODULE __) in a broadway_kafka pipeline. But the pipeline gets restarted after a minute by the brod supervisor :brod_sup. The restart strategy is fixed to permanent...
From PR #60 I've noticed we are not actually running the integration tests on CI. Also, the instructions recommend installing Kafka locally which I'd say is not common practice IMHO....
Hello! I'm busy playing with Broadway for a use-case with many pipeline's that are created & destroyed dynamically. The changes introduced in dashbitco/broadway#239 seem perfect for this by allowing pipeline...
I'm noticing a strange behavior when my broadway pipeline with 3 producers will sometimes goes into a prolonged group rebalancing cycle. After digging the code, seems like the problem boils...
I am receiving the following error in Sentry: ``` Sentry.CrashError: ** (exit) exited in: GenServer.call(#PID, :drain_after_revoke, :infinity) ** (EXIT) killed File "lib/gen_server.ex", line 1030, in GenServer.call/3 File "lib/broadway_kafka/producer.ex", line 525,...
Hello! As a result of the analysis of the previous issue (https://github.com/dashbitco/broadway_kafka/issues/112), it turned out that this was caused by deadlock. Deadlock on race between a) assigments_revoked callback call inside...
We got two error reports about the following: ``` ArgumentError: errors were found at the given arguments: * 1st argument: the table identifier does not refer to an existing ETS...