greyhound icon indicating copy to clipboard operation
greyhound copied to clipboard

Published 20 hours ago • verified publisher icon wix

Kafka transactions

Open JohnColeman-CTO opened this issue 4 years ago • 1 comments

Are transactions fully implemented?

I do not see anything in the code indicating that the feature is supported. This means that you cannot guarantee one time delivery in a consumer-producer pipeline.

JohnColeman-CTO avatar Jan 21 '21 11:01 JohnColeman-CTO

Hi @JohnColeman-CTO,

Currently Greyhound does not have support for exactly-once-processing (i.e. Kafka transactions). But we plan to introduce it in 2021.

The idea is to have an additional ExactlyOnceProcessor (which will encapsulate both a consumer and producer) alongside RecordConsumer (which provides at least once guarantees)

CC: @berman7

natansil avatar Jan 21 '21 12:01 natansil