kafka_ex
kafka_ex copied to clipboard
kafkaex
Kafka client library for Elixir
In https://github.com/kafkaex/kafka_ex/blob/master/lib/kafka_ex/gen_consumer/supervisor.ex#L92, we can see that the child is launched as a worker. As a consequence, the shutdown timeout is automatically set to 5_000 ms (among other default settings). However,...
Hello! [Telemetry](https://github.com/beam-telemetry/telemetry) is getting traction now that it's included in [Phoenix](https://github.com/phoenixframework/phoenix/commit/4d61eacd83d61899a895167715d8754c5c8187be) and [Ecto](https://github.com/elixir-ecto/ecto/commit/ee8a9ea002f8809825d3bd5a3bc34aa863f223ee) out-of-the-box. What's your stance on emitting telemetry events from this library? Would you welcome contributions? It would...
On the server side, kafka has a `auto.create.topics.enable` setting that determines whether a topic can be used "on the fly" without having to create it manually beforehand. In other languages/libraries,...
If the Kafka broker is not present/found, then the `KafkaEx.ConsumerGroup` crashes, which brings down the whole app. ``` 10:46:06.838 [error] Could not connect to broker "localhost":9092 because of error {:error,...
Hey guys, I noticed while using the library that there's many responses that `KafkaEx.publish/2` may produce. Namely: ```elixir nil :ok {:ok, integer} {:error, :closed} {:error, :inet.posix} {:error, any} iodata :leader_not_available...
We maintainers are discussing dropping the 0.8.0 and 0.8.2 client implementations. Does anyone in the community use these implementations or is everyone using the 0.9.0 implementation? Note that existing versions...
See #262 for an example of this causing confusion for a user. We should be able to check that the compression dependency is available at runtime. This could be a...
In #143 we more or less decided that supporting GenStage would be out of scope for this library. On the other hand, talking with some folks recently now that our...
The following can occur: * A topic exists with, say, 4 partitions. * A KafkaEx consumer group begins consuming from those partitions. * The topic is reconfigured to have, say,...
```22:19:06.717 [error] Receiving data from broker "stg-bitpipe-kafka03.pd-internal.com":9092 failed with :timeout =CRASH REPORT==== 2-Feb-2017::22:19:06 === crasher: initial call: Elixir.KafkaEx.Server0P9P0:init/1 pid: registered_name: 'cw:kafkanary:41' exception exit: {function_clause, [{'Elixir.KafkaEx.Protocol.Fetch',parse_response, [nil], [{file,"lib/kafka_ex/protocol/fetch.ex"}, {line,49}]},``` Fetch errors...
