scylla-cdc-java icon indicating copy to clipboard operation
scylla-cdc-java copied to clipboard

Published 20 hours ago • verified publisher icon scylladb

Read windows with lastConsumedChangeId efficiently

Open avelanarius opened this issue 3 years ago • 3 comments

Read windows with present lastConsumedChangeId more efficiently. Instead of filtering out rows on the client side, perform two queries to Scylla: first - reading a single partial stream, second - reading all consecutive entire streams.

TODO: Two modes of reading - single stream and multiple stream selects.

avelanarius avatar Feb 25 '22 06:02 avelanarius

Would there be a way to reduce the duplication a bit?

Yes, I'll work on that.

avelanarius avatar Mar 07 '22 13:03 avelanarius

@haaawk Pushed v2 - reduced duplication of code.

avelanarius avatar Mar 08 '22 14:03 avelanarius

@avelanarius @haaawk Hi. Is the scylladb cdc source connector not managed anymore?

https://github.com/scylladb/scylla-cdc-source-connector

pkgonan avatar May 30 '22 07:05 pkgonan