hermann
hermann copied to clipboard
Producer#push with an array of messages should call rd_kafka_produce_batch
Instead of calling rd_kafka_produce
through Herman::Lib::Producer#push_single
in a tight loop, we should call out to rd_kafka_produce_batch
which is a better suited batch API.
I don't know about this. My understanding of batch sends is meant only if you set the producer to be in async mode, i.e. producer.type = async (https://kafka.apache.org/documentation.html#producerconfigs).
Default producer is set to sync, if the producer is async you must also be careful of
queue.buffering.max.ms
queue.buffering.max.messages
queue.enqueue.timeout.ms
batch.num.messages