sdk icon indicating copy to clipboard operation
sdk copied to clipboard
verified publisher icon meltano

Support `LOG_BASED` replication method

Open MeltyBot opened this issue 3 years ago • 3 comments

Spec discussions here:

  • https://github.com/meltano/sdk/discussions/1012
  • https://github.com/meltano/sdk/discussions/1015

Migrated from GitLab: https://gitlab.com/meltano/sdk/-/issues/306

Originally created by @aaronsteers on 2022-01-19 03:37:10

We don't currently have any examples of SDK-based taps which use LOG_BASED replication. After merging !44, we can start exploring this method.

Community contributions welcomed.

MeltyBot avatar Jan 19 '22 03:01 MeltyBot

View 1 previous comment from the original issue on GitLab

MeltyBot avatar May 30 '22 00:05 MeltyBot

@tayloramurphy We discussed in the Singer Guild meeting of 2023-07-13, that it's probably better to address this once we have a reference implementation in a SQL tap, so I'm removing it from the V1 list if that's ok.

edgarrmondragon avatar Jul 14 '23 01:07 edgarrmondragon

@edgarrmondragon I don't like the idea of dropping this from v1. We've got Derek working Postgres and MySQL and I think we can implement this there. @visch what would it take to get log-based replication working and tested in postgres and mysql?

tayloramurphy avatar Jul 14 '23 16:07 tayloramurphy