flink-cdc icon indicating copy to clipboard operation
flink-cdc copied to clipboard

[Feature][Postgres] Support automatically identify newly added tables

Open TyrantLucifer opened this issue 2 years ago • 1 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Motivation

When we start a job with a regular expression, if a new table name matches the regular expression and is created, the event emitted by the table will not be captured and IllegalArgumentException will be thrown, causing the entire flash job to fail over.

Solution

When instantiating EventDispatcher, InconsistenceSchemaHandler is passed in, and all internal schema information is refreshed at this time.

Alternatives

No response

Anything else?

No response

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

TyrantLucifer avatar Aug 15 '23 11:08 TyrantLucifer

Great catch! Now debezium version has been upgraded to 1.9.8, maybe we can do some changes and then rebase this PR.

loserwang1024 avatar Feb 05 '24 09:02 loserwang1024

Closing this issue as it has been migrated to Apache Jira.

PatrickRen avatar Apr 09 '24 06:04 PatrickRen