kafka-python
kafka-python copied to clipboard
Messages exceeding the size are silently dropped
Hello,
I noticed some messages not being published to Kafka although the logs report no error, and it seems that if a message exceeds the maximum size (max_request_size
in the Producer, in my case corresponding to the value in the topic settings) it is discarded but no exception is raised.
Is this a known behavior?
A small update: calling flush()
after send()
I do get a warning:
WARNING kafka.producer.record_accumulator [Error 10] MessageSizeTooLargeError
it is a warning rather than an exception, but it's an improvement