readyset icon indicating copy to clipboard operation
readyset copied to clipboard

Improve MySQL replication processing

Open altmannmarcelo opened this issue 4 months ago • 0 comments

Description

Our current MySQL replication flow can be improved to process replication events faster. I Propose we do the following:

  1. Group events from the same transaction and dispatch them as a batch to Readyset. Currently we read one event and dispatch a single event. We should take into consideration compressed events.
  2. Pass table_filter object to replicator and skip events as soon as we read them. Currently we build the whole TableOperation and only discard the event in the noria code.

Change in user-visible behavior

Requires documentation change

altmannmarcelo avatar Sep 26 '24 14:09 altmannmarcelo