kafqa
kafqa copied to clipboard
Deal with Queue Full issue on High Produce Rate
When produced at higher rate librdkafka errors out Error producing message to kafka: Local: Queue full
.
- Expose configuration and means to edit queue.size
- Manage high throughput with batching
linger.ms
- Handle this error and sleep for configured time