confluent-kafka-python icon indicating copy to clipboard operation
confluent-kafka-python copied to clipboard

How to set delivery.reports to false ?

Open harniruthwik opened this issue 2 years ago • 4 comments

Description

Is there way to not receive any delivery reports from the broker or atleast not queue these delivery reports even if we receive them.I've seen a configuration delivery.report.only.error in librdkafka which if set to true, will queue only error delivery reports. Is there a way to completely stop this delivery reports ? It's okay if we lose messages without getting notified. I'm exploring this so we can avoid poll() call (I've heard someone reporting performance issues in production because of poll() call).

We are using confluent-kafka-python version 2.2.0 Other information in the checklist might not be relevant regarding the question hence not adding

How to reproduce

Checklist

Please provide the following information:

  • [x] confluent-kafka-python and librdkafka version (confluent_kafka.version() and confluent_kafka.libversion()):
  • [x] Apache Kafka broker version:
  • [x] Client configuration: {...}
  • [x] Operating system:
  • [x] Provide client logs (with 'debug': '..' as necessary)
  • [x] Provide broker log excerpts
  • [x] Critical issue

harniruthwik avatar Sep 12 '23 07:09 harniruthwik

Poll should never be avoided. It serves internal callbacks as well apart from delivery callbacks. Are you facing any performance issue regarding Poll? We should debug those issues instead of omitting Poll call.

pranavrth avatar Oct 17 '23 06:10 pranavrth

it's adding up 1-2 ms latency if we add poll(), no other performance issue.

harniruthwik avatar Oct 17 '23 06:10 harniruthwik

If this is fine with you then we can close this issue. But if you feel Poll is affecting your application, we can dig deeper to specific case in Poll which might be a concern.

pranavrth avatar Oct 18 '23 10:10 pranavrth

@harniruthwik wanted to follow up to see if this is still an issue you would like investigated

nhaq-confluent avatar Feb 12 '24 20:02 nhaq-confluent