Magnus Edenhill

Is there any possibility to spin up gdb or pstack to get a backtrace of the client when it is in a stalled state?

@silencev Sorry, timestamps and headers are not available in the delivery report. You can pass a user object of your choice with each produced message which you can retrieve in...

Please try to reproduce on the latest librdkafka version

This is a good idea, we should allow lists for config variables and automatically translate to CSV.

I have a vague memory that you're not allowed to pass the same partition multiple times in the same call.

Out of curiousity, can you share your custom partitioner? It might be generic enough to be integrated.

Okay, what you'll need to do in the meantime is get the partition count (with GetMetadata()) for your topic(s) and then run your partitioner prior to calling Produce() and setting...

The problem with implementing partitioner_cb support in high-level language bindings is that the partitioner callback **may** be called from an internal librdkafka thread and this isn't trivial to handle in...

@tchap the default partitioner is Consistent-Random, which maps the same key to the same partition, so you should be fine. https://github.com/edenhill/librdkafka/blob/master/src/rdkafka.h#L1606

The next version of librdkafka (the underlying Kafka client) will expose the builtin partitioners as configuration properties, allowing you to change to an alternative builtin partitioner, such as the Java...