flink-cdc icon indicating copy to clipboard operation
flink-cdc copied to clipboard

Published 20 hours ago • verified publisher icon apache

optimize the update operation in binlog events

Open shizhengchao opened this issue 5 years ago • 6 comments

Fixes #40： Add optional flag capture-unchanged-updates whether to capture the updates if that have no change or not. default true, false to disable, just simply equals the before and after RowData before assigining RowKind.,when before and after are equal, no update is performed.

shizhengchao avatar Sep 19 '20 16:09 shizhengchao

Hi @wuchong , to avoid the potential PSQLException: ERROR: replication slot "debezium" is active for PID xxx, i added slot.name options in postgres-cdc tests.

shizhengchao avatar Sep 23 '20 10:09 shizhengchao

Hi @wuchong, could you help to review this ? :)

shizhengchao avatar Oct 21 '20 14:10 shizhengchao

Hi @shizhengchao , we are busy working on the 1.12 release for Apache Flink (the feature cut will happen on 2nd Nov.). Will review the pull requests after that. Sorry for the delay!

wuchong avatar Oct 22 '20 03:10 wuchong

Hello @shizhengchao, sorry for the long delay of this PR. Could you please help rebase it with latest master branch before we can merge this?

Kindly reminder about some refactored packages:

  • RowDataDebeziumDeserializeSchema com.alibaba.ververica.cdc.debezium.table → org.apache.flink.cdc.debezium.table
  • MySQLTableSource and MySQLTableSourceFactory com.alibaba.ververica.cdc.connectors.mysql.table → org.apache.flink.cdc.connectors.mysql.table
  • PostgreSQLTableSource and PostgreSQLTableFactory com.alibaba.ververica.cdc.connectors.postgres.table → org.apache.flink.cdc.connectors.postgres.table

Also, there are a lot of new connectors added into Flink CDC since this PR was submitted. Maybe we can bring the capture-unchanged-updates option to more connectors?

Thanks again for your generous contribution!

yuxiqian avatar Apr 25 '24 05:04 yuxiqian

This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs.

github-actions[bot] avatar Jul 17 '24 00:07 github-actions[bot]

This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs.

github-actions[bot] avatar Sep 24 '24 00:09 github-actions[bot]

This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs.

github-actions[bot] avatar Nov 24 '24 00:11 github-actions[bot]

This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encouraged to continue work on this pull request.

github-actions[bot] avatar Dec 25 '24 00:12 github-actions[bot]