flink-cdc

flink-cdc copied to clipboard

### Discussed in https://github.com/ververica/flink-cdc-connectors/discussions/1531 Originally posted by **lijun0314** September 1, 2022 Hi, developers, I am new to flink-cdc-connectors, I got two MariaDB databases running on machines A and B, I...

water5-cmd

问题：生产环境下connector可能会对mysql server的造成i/o压力? 是否支持mysql server的主从切换？

23

问题1：binlog复制问题，这个 conentor (mysql-cdc)在定义源表时，定义几张表，就会建立几个链接去读binlog；感觉有点浪费，作业所需表多了几后，mysql应该i/o压力会比较大？ 比如我定义两张表，连的都是同一个mysql server // 输入表test CREATE TABLE test ( idINT,nameVARCHAR(255),timeTIMESTAMP(3),status` INT, PRIMARY KEY(id) NOT ENFORCED ) WITH ( 'connector' = 'mysql-cdc', 'hostname' = 'localhost', 'port' = '3306', 'username'...

jindyliu

**Describe the bug(Please use English)** I was using debezium_signal table to do an ad hoc snapshot, but got NullPointerException at io.debezium.pipeline.signal.ExecuteSnapshot.arrived(ExecuteSnapshot.java:64) **Environment :** - Flink version : 1.14.4 - Flink...

samanhappy

数据传输过程中，job无法cancel掉

2

2020-12-18 22:38:00,329 WARN org.apache.flink.runtime.taskmanager.Task [] - Task 'Source: TableSourceScan(table=[[default_catalog, default_database, 表名]], fields=[字段名]) -> MiniBatchAssigner(interval=[2000ms], mode=[ProcTime]) -> Calc(select=[sql语句]) (1/1)' did not react to cancelling signal for 30 seconds, but is stuck...

laifulin

Can each flink-cdc task only subscribe to one table? After reading the source code, I found that CDCClient can only pull the change log of one table. Can each CDCClient...

MengXiangDing

无法指定链接参数 AllowPublicKeyRetrieval=True

7

在使用 mysql 8.0 的时候报下面的，需要指定链接参数 AllowPublicKeyRetrieval=True，但是没有找到配置的地方 `Caused by: java.sql.SQLNonTransientConnectionException: Public Key Retrieval is not allowed at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:836) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:456) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:246) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:197) at io.debezium.jdbc.JdbcConnection.lambda$patternBasedFactory$1(JdbcConnection.java:230)...

springMoon

reduce number of BinlogSplitMetaEvent transmission between MySqlSoureReader and MySqlSourceEnumerator; fixed log MySqlSourceEnumerator

lidoudou1993

**Describe the bug(Please use English)** Elasticsearch7 connection reset by peer **Environment :** - Flink version : 1.13.6 - Flink CDC version: 2.2.1 - Database and version: mysql-5.7 - Flink-sql-connector-elasticsearch7: 2.11-1.13.6...

kim-up

[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector

3

Is your feature request related to a problem? Please describe. Adapt Postgres CDC Connector to the abstraction framework of https://github.com/ververica/flink-cdc-connectors/issues/724

leonardBang

flink sql cdc 占用 大量数据库连接 怎么办

1

flink sql cdc 占用 大量数据库连接 怎么办，大约12 job 占用了63 个数据库连接

lyc88