Piotr Jastrzębski
Piotr Jastrzębski
> > pkgonan: I remember that when I registered ScyllaDB Source Connectors in the Kafka Connect Cluster in the past, the read requests increased several times for a certain period...
> @haaawk @hartmut-co-uk The test was performed on a new empty table that does not generate cdc log. The problem arises even though it is a table with no create,...
> 1. Maybe allow to configure the connector (+scylla-cdc-java) to start reading CDC from either `earliest|latest`? This can be done easily but will require the user not to send any...
> Regarding `window.size` - I think it's also sort of a general issue when trying to reduce the latency (how long it takes from X := write to scylla table...
> 🙇 Oh! Great to hear raft will also be beneficial for this use case. May I kindly ask on which release train this is? I'm not sure. Raft is...
@avelanarius Let's do the while for now but let's not close this issue and do smart resuming whenever the time allows.
On a second thought, I don't think while will work. Unless not a simple while. we can do while over getAvailableWithoutFetching elements but not more. Fetching more is blocking and...
Seems like a problem here https://github.com/scylladb/scylla-cdc-java/blob/c0d6e41c30269d681517a57b94e1d681c27e33f6/scylla-cdc-replicator/src/main/java/com/scylladb/cdc/replicator/operations/update/PreparedUpdateOperationHandler.java#L21
In such case the statement will look like `UPDATE ks.tb SET WHERE pk1 = ? AND pk2 = ? AND ck1 = ? ...` This might be illegal.