pykafka icon indicating copy to clipboard operation
pykafka copied to clipboard

Published 20 hours ago • verified publisher icon Parsely

Support RecordBatch

Open emmettbutler opened this issue 7 years ago • 1 comments

Since Kafka 0.11, the MessageSet format has had an updated version called RecordBatch. We should investigate what it would take to support this format, and what the benefits would be. This will probably require significant changes within protocol.py to intelligently switch between MessageSet implementations based on Kafka broker version.

emmettbutler avatar Jul 11 '18 17:07 emmettbutler

There is also a change to MessageSet in 0.10 (the addition of timestamp) that should be supported.

emmettbutler avatar Jul 25 '18 22:07 emmettbutler