kafka icon indicating copy to clipboard operation
kafka copied to clipboard

err: gzip: invalid header

Open butnet opened this issue 6 years ago • 3 comments

https://github.com/optiopay/kafka/blob/1ad0bf381e31017cf3f5858d69f1d2e0ddca2642/broker.go#L1218

the same message can be receive by client in java.

butnet avatar Aug 09 '19 06:08 butnet

Hello @butnet,

Could you provide more context?

dgellow avatar Sep 17 '19 09:09 dgellow

@dgellow : it can't repet in my local environmental, it happen in prod environmental. I just get the error message, no more.

butnet avatar Sep 27 '19 08:09 butnet

Hi, I got the same issue after a module upgrade. I narrowed it down to the consumer's MaxFetchSize param. I had to set it explicitely to 0 to solve the issue as setting it to any number up to INT32_MAX didn't help.

As for the context, I am consuming big gziped json messages. Once unzipped, they can expand to 3 or 4MB but stay below 2MB when zipped.

vma avatar Feb 18 '20 14:02 vma