kafqa icon indicating copy to clipboard operation
kafqa copied to clipboard

Deal with Queue Full issue on High Produce Rate

Open devdinu opened this issue 5 years ago • 0 comments

When produced at higher rate librdkafka errors out Error producing message to kafka: Local: Queue full.

  • Expose configuration and means to edit queue.size
  • Manage high throughput with batching linger.ms
  • Handle this error and sleep for configured time

devdinu avatar Aug 06 '19 05:08 devdinu