kafka-go icon indicating copy to clipboard operation
kafka-go copied to clipboard

Published 20 hours ago • verified publisher icon segmentio

Is it possible to do crc checking when consuming?

Open lizhifengones opened this issue 3 years ago • 2 comments

It seems as if the Consumer does not support crc checking by default when fetching messages and I cannot find any configuration that enables it. In addition, the client library does not expose enough information for users of the library to do it themselves.

lizhifengones avatar May 15 '22 07:05 lizhifengones

For example after downloading a file it is a good practice to check the file md5 checksum (rather than just relying on the tcp checksum).

I think we should support checks.crc configurable.

lizhifengones avatar May 15 '22 08:05 lizhifengones

Thanks for bringing this up! We have some work being done on the Reader which should address this limitation as well, but since that isn't done yet I'll leave this issue open for the time-being and will follow up when we have more details to share.

dominicbarnes avatar Jun 03 '22 17:06 dominicbarnes