How to sync delete operation using Neo4j Kafka Connector?
Hello,
We used Neo4j Streams to sync data in Neo4j 4.4 (Community) and it works very good. But recently we are planning to upgrade to Neo4j 5.x (Community). Then we found that according to this doc's note, Neo4j Streams is no longer under active development and will not be supported after version 4.4 of Neo4j. But it seems that Neo4j Kafka Connector only supports data sync incrementally. Then how can I sync delete operation?
Hi @SherlockZh,
Kafka Connect Neo4j Source Connector doesn’t support capturing and publishing deletion events. However, Neo4j 5 has introduced the Change Data Capture (CDC) feature (currently in beta), which might fit your case. You can find documentation here. We are working on a Kafka Connector supporting CDC, and expecting a public beta release soon.
Hi @venikkin,
Thank you for your advice. But it looks like this CDC feature only support the Neo4j Enterprise version. But we are currently using Community version and are more likely to continue using Neo4j 5.x Community as well. So we prefer there could be a similiar solution for 5.x Community version just like what we used in 4.4.
And btw, does this future "Kafka Connector supported CDC" support Community version? Or only for Enterprise too?
Hi @SherlockZh
I'm afraid, CDC will be supported only by the Enterprise.