[Bug] [sqlservercdc-x] sql脚本配置的lsn无法生效

Open waryars opened this issue 2 years ago • 0 comments

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened

无法读取配置的lsn历史时点之后的数据，甚至在日志里没看到配置的lsn信息：

What you expected to happen

希望从日志点lsn开始读取数据

How to reproduce

一、环境准备 1、sqlserver版本信息 Microsoft SQL Server 2017 (RTM-CU21) (KB4557397) - 14.0.3335.7 (X64) Jun 12 2020 20:39:00 Copyright (C) 2017 Microsoft Corporation Enterprise Edition (64-bit) on Linux (CentOS Linux 7 (Core)) 2、已开启cdc配置 3、源端表结构信息

二、配置脚本 [root@t-hadoop01 sqlservercdc]# cat sqlservercdc_stream_test222.sql CREATE TABLE test2 ( id varchar, age int, cname varchar, sale_amt decimal(18,2), ttime timestamp ) WITH ( 'connector' = 'sqlservercdc-x' ,'username' = 'sa' ,'password' = 'passwd' ,'cat' = 'insert,delete,update' ,'lsn' = '0002e716:00617928:0001' ,'url' = 'jdbc:sqlserver://172.16.51.141:1433;databaseName=GISS_TEST' ,'table' = 'dbo.test2' ,'database' = 'GISS_TEST' ,'poll-interval' = '1000' );

CREATE TABLE sink ( id varchar, age int, cname varchar, sale_amt decimal(18,2), ttime timestamp ) WITH ( 'connector' = 'stream-x' );

insert into sink select * from test2 u;

三、执行命令 [root@t-hadoop01 chunjun-dist112]# sh bin/chunjun-local.sh -job chunjun-examples/sql/sqlservercdc/sqlservercdc_stream_test222.sql

四、执行结果无法读取lsn历史时点后的记录，日志打印的信息也没有lsn的配置信息。

[root@t-hadoop01 chunjun-dist112]# sh bin/chunjun-local.sh -job chunjun-examples/sql/sqlservercdc/sqlservercdc_stream_test222.sql

      #                               #
      #                               #
      #

###### # # # #### #### # # #

# # # # ## # # # # ##

# # # # # # # # # #

# # # ## # # # # ## #

# # #### # # # # #### # #

                                      #
                                  ####

Reference site: https://dtstack.github.io/chunjun

chunjun is starting ... CHUNJUN_HOME is auto set /opt/chunjun-dist112/chunjun-dist FLINK_HOME is /opt/flink-1.12.7 HADOOP_HOME is /usr/hdp/2.6.2.14-5/hadoop

start command: /opt/jdk1.8.0_131/bin/java -cp /opt/chunjun-dist112/chunjun-dist/../lib/* com.dtstack.chunjun.client.Launcher -job chunjun-examples/sql/sqlservercdc/sqlservercdc_stream_test222.sql -mode local -jobType sql -chunjunDistDir /opt/chunjun-dist112/chunjun-dist -flinkConfDir /opt/flink-1.12.7/conf -flinkLibDir /opt/flink-1.12.7/lib -hadoopConfDir /usr/hdp/2.6.2.14-5/hadoop/etc/hadoop

2023-10-10 07:42:27,382 - 0 INFO [main] com.dtstack.chunjun.Main:------------program params------------------------- 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:-flinkLibDir 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:/opt/flink-1.12.7/lib 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:-p 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main: 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:-job 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:CREATE+TABLE+test2%0A%28%0A++++id+varchar%2C%0A++++age+int%2C%0A++++cname+varchar%2C%0A++++sale_amt+decimal%2818%2C2%29%2C%0A++++ttime+timestamp+%0A%29+WITH+%28%0A++++++%27connector%27+%3D+%27sqlservercdc-x%27%0A++++++%2C%27username%27+%3D+%27sa%27%0A++++++%2C%27password%27+%3D+%271qaz2wsx.com%27%0A++++++%2C%27cat%27+%3D+%27insert%2Cdelete%2Cupdate%27%0A++++++%2C%27lsn%27+%3D+%270002e716%3A00617928%3A0001%27%0A++++++%2C%27url%27+%3D+%27jdbc%3Asqlserver%3A%2F%2F172.16.51.141%3A1433%3BdatabaseName%3DGISS_TEST%27%0A++++++%2C%27table%27+%3D+%27dbo.test2%27%0A++++++%2C%27database%27+%3D+%27GISS_TEST%27%0A++++++%2C%27poll-interval%27+%3D+%271000%27%0A++++++%29%3B%0A%0ACREATE+TABLE+sink%0A%28%0A++++id+varchar%2C%0A++++age+int%2C%0A++++cname+varchar%2C%0A++++sale_amt+decimal%2818%2C2%29%2C%0A++++ttime+timestamp+%0A%29+WITH+%28%0A++++++%27connector%27+%3D+%27stream-x%27%0A++++++%29%3B%0A%0Ainsert+into+sink%0Aselect+%0Afrom+test2+u%3B%0A 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:-jobName 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:Flink_Job 2023-10-10 07:42:27,429 - 47 INFO [main] com.dtstack.chunjun.Main:-chunjunDistDir 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:/opt/chunjun-dist112/chunjun-dist 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-jobType 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:sql 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-hadoopConfDir 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:/usr/hdp/2.6.2.14-5/hadoop/etc/hadoop 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-confProp 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:{} 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-pluginLoadMode 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:shipfile 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-mode 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:local 2023-10-10 07:42:27,430 - 48 INFO [main] com.dtstack.chunjun.Main:-flinkConfDir 2023-10-10 07:42:27,431 - 49 INFO [main] com.dtstack.chunjun.Main:/opt/flink-1.12.7/conf 2023-10-10 07:42:27,431 - 49 INFO [main] com.dtstack.chunjun.Main:------------------------------------------- 2023-10-10 07:42:27,461 - 79 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: jobmanager.rpc.address, t-hadoop01 2023-10-10 07:42:27,461 - 79 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: jobmanager.rpc.port, 6123 2023-10-10 07:42:27,461 - 79 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: jobmanager.memory.process.size, 1600m 2023-10-10 07:42:27,461 - 79 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: taskmanager.memory.process.size, 1728m 2023-10-10 07:42:27,461 - 79 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: taskmanager.numberOfTaskSlots, 4 2023-10-10 07:42:27,462 - 80 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: parallelism.default, 1 2023-10-10 07:42:27,462 - 80 INFO [main] org.apache.flink.configuration.GlobalConfiguration:Loading configuration property: jobmanager.execution.failover-strategy, region 2023-10-10 07:42:28,414 - 1032 INFO [main] com.dtstack.chunjun.Main:Register to table configuration:{table.dynamic-table-options.enabled=true, pipeline.name=Flink_Job} 2023-10-10 07:42:28,437 - 1055 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun executionMode: local 2023-10-10 07:42:28,437 - 1055 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun reset pipeline.jars: [file:/opt/chunjun-dist112/chunjun-dist/chunjun-core.jar] 2023-10-10 07:42:28,437 - 1055 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun executionMode: local 2023-10-10 07:42:28,437 - 1055 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun reset pipeline.jars: [file:/opt/chunjun-dist112/chunjun-dist/chunjun-core.jar] 2023-10-10 07:42:28,632 - 1250 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun executionMode: local 2023-10-10 07:42:28,632 - 1250 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun reset pipeline.jars: [file:/opt/chunjun-dist112/chunjun-dist/chunjun-core.jar, file:/opt/chunjun-dist112/chunjun-dist/connector/sqlservercdc/chunjun-connector-sqlservercdc.jar] 2023-10-10 07:42:29,162 - 1780 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun executionMode: local 2023-10-10 07:42:29,162 - 1780 INFO [main] com.dtstack.chunjun.util.PluginUtil:ChunJun reset pipeline.jars: [file:/opt/chunjun-dist112/chunjun-dist/chunjun-core.jar, file:/opt/chunjun-dist112/chunjun-dist/connector/sqlservercdc/chunjun-connector-sqlservercdc.jar, file:/opt/chunjun-dist112/chunjun-dist/connector/stream/chunjun-connector-stream.jar] 2023-10-10 07:42:30,313 - 2931 INFO [main] org.apache.flink.configuration.Configuration:Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' 2023-10-10 07:42:30,316 - 2934 WARN [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The resource configuration option Key: 'taskmanager.memory.process.size' , default: null (fallback keys: []) is set but it will have no effect for local execution, only the following options matter for the resource configuration: [Key: 'taskmanager.memory.process.size' , default: null (fallback keys: []), Key: 'taskmanager.memory.flink.size' , default: null (fallback keys: []), Key: 'taskmanager.memory.framework.heap.size' , default: 128 mb (fallback keys: []), Key: 'taskmanager.memory.framework.off-heap.size' , default: 128 mb (fallback keys: []), Key: 'taskmanager.memory.jvm-metaspace.size' , default: 256 mb (fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.min' , default: 192 mb (fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.max' , default: 1 gb (fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.fraction' , default: 0.1 (fallback keys: [])] 2023-10-10 07:42:30,316 - 2934 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value. 2023-10-10 07:42:30,316 - 2934 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value. 2023-10-10 07:42:30,316 - 2934 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value. 2023-10-10 07:42:30,316 - 2934 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb. 2023-10-10 07:42:30,316 - 2934 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb. 2023-10-10 07:42:30,317 - 2935 INFO [main] org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils:The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb. 2023-10-10 07:42:30,328 - 2946 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Starting Flink Mini Cluster 2023-10-10 07:42:30,330 - 2948 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Starting Metrics Registry 2023-10-10 07:42:30,370 - 2988 INFO [main] org.apache.flink.runtime.metrics.MetricRegistryImpl:No metrics reporter configured, no metrics will be exposed/reported. 2023-10-10 07:42:30,370 - 2988 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Starting RPC Service(s) 2023-10-10 07:42:30,383 - 3001 INFO [main] org.apache.flink.runtime.clusterframework.BootstrapTools:Trying to start local actor system 2023-10-10 07:42:30,770 - 3388 INFO [flink-akka.actor.default-dispatcher-2] akka.event.slf4j.Slf4jLogger$$anonfun$receive$1:Slf4jLogger started 2023-10-10 07:42:30,856 - 3474 INFO [main] org.apache.flink.runtime.clusterframework.BootstrapTools:Actor system started at akka://flink 2023-10-10 07:42:30,867 - 3485 INFO [main] org.apache.flink.runtime.clusterframework.BootstrapTools:Trying to start local actor system 2023-10-10 07:42:30,878 - 3496 INFO [flink-metrics-2] akka.event.slf4j.Slf4jLogger$$anonfun$receive$1:Slf4jLogger started 2023-10-10 07:42:30,885 - 3503 INFO [main] org.apache.flink.runtime.clusterframework.BootstrapTools:Actor system started at akka://flink-metrics 2023-10-10 07:42:30,895 - 3513 INFO [main] org.apache.flink.runtime.rpc.akka.AkkaRpcService:Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . 2023-10-10 07:42:30,944 - 3562 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Starting high-availability services 2023-10-10 07:42:30,953 - 3571 INFO [main] org.apache.flink.runtime.blob.BlobServer:Created BLOB server storage directory /tmp/blobStore-087dbbbe-70b8-4f8e-b70e-001ec7ab6c16 2023-10-10 07:42:30,958 - 3576 INFO [main] org.apache.flink.runtime.blob.BlobServer:Started BLOB server at 0.0.0.0:23110 - max concurrent requests: 50 - max backlog: 1000 2023-10-10 07:42:30,960 - 3578 INFO [main] org.apache.flink.runtime.blob.AbstractBlobCache:Created BLOB cache storage directory /tmp/blobStore-66308fc6-16a0-4098-9161-ee0b0abf107c 2023-10-10 07:42:30,962 - 3580 INFO [main] org.apache.flink.runtime.blob.AbstractBlobCache:Created BLOB cache storage directory /tmp/blobStore-b3e8efc4-9c4a-4a49-86df-42ee1d3b1409 2023-10-10 07:42:30,962 - 3580 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Starting 1 TaskManger(s) 2023-10-10 07:42:30,965 - 3583 INFO [main] org.apache.flink.runtime.taskexecutor.TaskManagerRunner:Starting TaskManager with ResourceID: a21d10a4-d647-4ad1-bd88-ccb11ede21c6 2023-10-10 07:42:30,976 - 3594 INFO [main] org.apache.flink.runtime.taskexecutor.TaskManagerServices:Temporary file directory '/tmp': total 49 GB, usable 18 GB (36.73% usable) 2023-10-10 07:42:30,979 - 3597 INFO [main] org.apache.flink.runtime.io.disk.FileChannelManagerImpl:FileChannelManager uses directory /tmp/flink-io-d25d8d20-9c6b-48d7-8042-c70c4630147e for spill files. 2023-10-10 07:42:30,984 - 3602 INFO [main] org.apache.flink.runtime.io.disk.FileChannelManagerImpl:FileChannelManager uses directory /tmp/flink-netty-shuffle-b94dd9a1-7f5d-469a-b0d9-f329d16db6be for spill files. 2023-10-10 07:42:31,014 - 3632 INFO [main] org.apache.flink.runtime.io.network.buffer.NetworkBufferPool:Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). 2023-10-10 07:42:31,022 - 3640 INFO [main] org.apache.flink.runtime.io.network.NettyShuffleEnvironment:Starting the network environment and its components. 2023-10-10 07:42:31,023 - 3641 INFO [main] org.apache.flink.runtime.taskexecutor.KvStateService:Starting the kvState service and its components. 2023-10-10 07:42:31,043 - 3661 INFO [main] org.apache.flink.runtime.rpc.akka.AkkaRpcService:Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 . 2023-10-10 07:42:31,052 - 3670 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService:Start job leader service. 2023-10-10 07:42:31,053 - 3671 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.filecache.FileCache:User file cache uses directory /tmp/flink-dist-cache-37a8537b-0b6f-4c03-a658-caaad460fb2a 2023-10-10 07:42:31,084 - 3702 INFO [main] org.apache.flink.runtime.rest.RestServerEndpoint:Starting rest endpoint. 2023-10-10 07:42:31,151 - 3769 WARN [main] org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation:Log file environment variable 'log.file' is not set. 2023-10-10 07:42:31,152 - 3770 WARN [main] org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation:JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'. 2023-10-10 07:42:31,276 - 3894 INFO [main] org.apache.flink.runtime.rest.RestServerEndpoint:Rest endpoint listening at t-hadoop01:13247 2023-10-10 07:42:31,276 - 3894 INFO [main] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Proposing leadership to contender http://t-hadoop01:13247 2023-10-10 07:42:31,278 - 3896 INFO [main] org.apache.flink.runtime.webmonitor.WebMonitorEndpoint:Web frontend listening at http://t-hadoop01:13247. 2023-10-10 07:42:31,278 - 3896 INFO [mini-cluster-io-thread-1] org.apache.flink.runtime.webmonitor.WebMonitorEndpoint:http://t-hadoop01:13247 was granted leadership with leaderSessionID=efa705bb-4e17-4fec-a73b-0bed51f0465e 2023-10-10 07:42:31,278 - 3896 INFO [mini-cluster-io-thread-1] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Received confirmation of leadership for leader http://t-hadoop01:13247 , session=efa705bb-4e17-4fec-a73b-0bed51f0465e 2023-10-10 07:42:31,290 - 3908 INFO [main] org.apache.flink.runtime.rpc.akka.AkkaRpcService:Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_1 . 2023-10-10 07:42:31,300 - 3918 INFO [main] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Proposing leadership to contender LeaderContender: DefaultDispatcherRunner 2023-10-10 07:42:31,301 - 3919 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Proposing leadership to contender LeaderContender: StandaloneResourceManager 2023-10-10 07:42:31,302 - 3920 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.resourcemanager.ResourceManager:ResourceManager akka://flink/user/rpc/resourcemanager_1 was granted leadership with fencing token 9009bc0781ab26d450a2a045e9234ccd 2023-10-10 07:42:31,303 - 3921 INFO [main] org.apache.flink.runtime.minicluster.MiniCluster:Flink Mini Cluster started successfully 2023-10-10 07:42:31,305 - 3923 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl:Starting the SlotManager. 2023-10-10 07:42:31,306 - 3924 INFO [mini-cluster-io-thread-2] org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess:Start SessionDispatcherLeaderProcess. 2023-10-10 07:42:31,307 - 3925 INFO [mini-cluster-io-thread-5] org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess:Recover all persisted job graphs. 2023-10-10 07:42:31,308 - 3926 INFO [mini-cluster-io-thread-5] org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess:Successfully recovered 0 persisted job graphs. 2023-10-10 07:42:31,308 - 3926 INFO [mini-cluster-io-thread-6] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Received confirmation of leadership for leader akka://flink/user/rpc/resourcemanager_1 , session=50a2a045-e923-4ccd-9009-bc0781ab26d4 2023-10-10 07:42:31,310 - 3928 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.taskexecutor.TaskExecutor:Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(9009bc0781ab26d450a2a045e9234ccd). 2023-10-10 07:42:31,313 - 3931 INFO [mini-cluster-io-thread-5] org.apache.flink.runtime.rpc.akka.AkkaRpcService:Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_2 . 2023-10-10 07:42:31,320 - 3938 INFO [mini-cluster-io-thread-5] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Received confirmation of leadership for leader akka://flink/user/rpc/dispatcher_2 , session=98d68fc9-1001-485b-a64c-9d7f3cd14f36 2023-10-10 07:42:31,330 - 3948 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.registration.RetryingRegistration:Resolved ResourceManager address, beginning registration 2023-10-10 07:42:31,335 - 3953 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.resourcemanager.ResourceManager:Registering TaskManager with ResourceID a21d10a4-d647-4ad1-bd88-ccb11ede21c6 (akka://flink/user/rpc/taskmanager_0) at ResourceManager 2023-10-10 07:42:31,336 - 3954 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.taskexecutor.TaskExecutorToResourceManagerConnection:Successful registration at resource manager akka://flink/user/rpc/resourcemanager_1 under registration id 9dc00800e80b1cb5a8ea01bf6dd1860f. 2023-10-10 07:42:31,560 - 4178 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.dispatcher.Dispatcher:Received JobGraph submission fdfedae63334afa922a44c7b4120366a (Flink_Job). 2023-10-10 07:42:31,561 - 4179 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.dispatcher.Dispatcher:Submitting job fdfedae63334afa922a44c7b4120366a (Flink_Job). 2023-10-10 07:42:31,572 - 4190 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Proposing leadership to contender LeaderContender: JobManagerRunnerImpl 2023-10-10 07:42:31,578 - 4196 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.rpc.akka.AkkaRpcService:Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_3 . 2023-10-10 07:42:31,583 - 4201 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.jobmaster.JobMaster:Initializing job Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,596 - 4214 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.scheduler.DefaultSchedulerFactory:Using restart back off time strategy NoRestartBackoffTimeStrategy for Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,606 - 4224 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder:start to buildGraph for job Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,629 - 4247 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder:trying to download shipFile from blobServer for job Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,629 - 4247 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder:Running initialization on master for job Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,640 - 4258 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder:Successfully ran initialization on master in 11 ms. 2023-10-10 07:42:31,652 - 4270 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology:Built 1 pipelined regions in 0 ms 2023-10-10 07:42:31,662 - 4280 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.state.StateBackendLoader:No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) 2023-10-10 07:42:31,672 - 4290 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.checkpoint.CheckpointCoordinator:No checkpoint found during restore. 2023-10-10 07:42:31,674 - 4292 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.scheduler.DefaultScheduler:Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@365a18fe for Flink_Job (fdfedae63334afa922a44c7b4120366a). 2023-10-10 07:42:31,682 - 4300 INFO [mini-cluster-io-thread-12] org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl:JobManager runner for job Flink_Job (fdfedae63334afa922a44c7b4120366a) was granted leadership with session id a50cc5de-3b72-458c-86f2-3ad89719da24 at akka://flink/user/rpc/jobmanager_3. 2023-10-10 07:42:31,684 - 4302 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.jobmaster.JobMaster:Starting execution of job Flink_Job (fdfedae63334afa922a44c7b4120366a) under job master id 86f23ad89719da24a50cc5de3b72458c. 2023-10-10 07:42:31,686 - 4304 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.scheduler.DefaultScheduler:Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2023-10-10 07:42:31,686 - 4304 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.executiongraph.ExecutionGraph:Job Flink_Job (fdfedae63334afa922a44c7b4120366a) switched from state CREATED to RUNNING. 2023-10-10 07:42:31,690 - 4308 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.executiongraph.Execution:Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1) (c8706b97efab23b2d6030fbc8dc1f9e3) switched from CREATED to SCHEDULED. 2023-10-10 07:42:31,697 - 4315 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl:Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{e8b4acdfd943a72a155f17807dc553a1}] 2023-10-10 07:42:31,702 - 4320 INFO [jobmanager-future-thread-1] org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService:Received confirmation of leadership for leader akka://flink/user/rpc/jobmanager_3 , session=a50cc5de-3b72-458c-86f2-3ad89719da24 2023-10-10 07:42:31,702 - 4320 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.jobmaster.JobMaster:Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(9009bc0781ab26d450a2a045e9234ccd) 2023-10-10 07:42:31,704 - 4322 INFO [flink-akka.actor.default-dispatcher-6] org.apache.flink.runtime.registration.RetryingRegistration:Resolved ResourceManager address, beginning registration 2023-10-10 07:42:31,706 - 4324 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.resourcemanager.ResourceManager:Registering job manager 86f23ad89719da24a50cc5de3b72458c@akka://flink/user/rpc/jobmanager_3 for job fdfedae63334afa922a44c7b4120366a. 2023-10-10 07:42:31,711 - 4329 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.resourcemanager.ResourceManager:Registered job manager 86f23ad89719da24a50cc5de3b72458c@akka://flink/user/rpc/jobmanager_3 for job fdfedae63334afa922a44c7b4120366a. 2023-10-10 07:42:31,713 - 4331 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.jobmaster.JobMaster:JobManager successfully registered at ResourceManager, leader id: 9009bc0781ab26d450a2a045e9234ccd. 2023-10-10 07:42:31,714 - 4332 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl:Requesting new slot [SlotRequestId{e8b4acdfd943a72a155f17807dc553a1}] and profile ResourceProfile{UNKNOWN} with allocation id 9470fa1a6dad2d03077d035e8fe7502c from resource manager. 2023-10-10 07:42:31,714 - 4332 INFO [flink-akka.actor.default-dispatcher-2] org.apache.flink.runtime.resourcemanager.ResourceManager:Request slot with profile ResourceProfile{UNKNOWN} for job fdfedae63334afa922a44c7b4120366a with allocation id 9470fa1a6dad2d03077d035e8fe7502c. 2023-10-10 07:42:31,717 - 4335 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.taskexecutor.TaskExecutor:Receive slot request 9470fa1a6dad2d03077d035e8fe7502c for job fdfedae63334afa922a44c7b4120366a from resource manager with leader id 9009bc0781ab26d450a2a045e9234ccd. 2023-10-10 07:42:31,722 - 4340 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.taskexecutor.TaskExecutor:Allocated slot for 9470fa1a6dad2d03077d035e8fe7502c. 2023-10-10 07:42:31,724 - 4342 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService:Add job fdfedae63334afa922a44c7b4120366a for job leader monitoring. 2023-10-10 07:42:31,726 - 4344 INFO [mini-cluster-io-thread-18] org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService$JobManagerLeaderListener:Try to register at job manager akka://flink/user/rpc/jobmanager_3 with leader id a50cc5de-3b72-458c-86f2-3ad89719da24. 2023-10-10 07:42:31,729 - 4347 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.registration.RetryingRegistration:Resolved JobManager address, beginning registration 2023-10-10 07:42:31,732 - 4350 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService$JobManagerLeaderListener$JobManagerRegisteredRpcConnection:Successful registration at job manager akka://flink/user/rpc/jobmanager_3 for job fdfedae63334afa922a44c7b4120366a. 2023-10-10 07:42:31,732 - 4350 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.TaskExecutor:Establish JobManager connection for job fdfedae63334afa922a44c7b4120366a. 2023-10-10 07:42:31,734 - 4352 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.TaskExecutor:Offer reserved slots to the leader of job fdfedae63334afa922a44c7b4120366a. 2023-10-10 07:42:31,740 - 4358 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.executiongraph.Execution:Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1) (c8706b97efab23b2d6030fbc8dc1f9e3) switched from SCHEDULED to DEPLOYING. 2023-10-10 07:42:31,740 - 4358 INFO [flink-akka.actor.default-dispatcher-3] org.apache.flink.runtime.executiongraph.Execution:Deploying Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1) (attempt #0) with attempt id c8706b97efab23b2d6030fbc8dc1f9e3 to a21d10a4-d647-4ad1-bd88-ccb11ede21c6 @ localhost (dataPort=-1) with allocation id 9470fa1a6dad2d03077d035e8fe7502c 2023-10-10 07:42:31,745 - 4363 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl:Activate slot 9470fa1a6dad2d03077d035e8fe7502c. 2023-10-10 07:42:31,761 - 4379 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.TaskExecutor:Received task Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0 (c8706b97efab23b2d6030fbc8dc1f9e3), deploy into slot with allocation id 9470fa1a6dad2d03077d035e8fe7502c. 2023-10-10 07:42:31,762 - 4380 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0 (c8706b97efab23b2d6030fbc8dc1f9e3) switched from CREATED to DEPLOYING. 2023-10-10 07:42:31,764 - 4382 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl:Activate slot 9470fa1a6dad2d03077d035e8fe7502c. 2023-10-10 07:42:31,766 - 4384 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Loading JAR files for task Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0 (c8706b97efab23b2d6030fbc8dc1f9e3) [DEPLOYING]. 2023-10-10 07:42:31,767 - 4385 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Registering task at network: Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0 (c8706b97efab23b2d6030fbc8dc1f9e3) [DEPLOYING]. 2023-10-10 07:42:31,767 - 4385 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Obtaining local cache file for 'class_path_2'. 2023-10-10 07:42:31,768 - 4386 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Obtaining local cache file for 'class_path_1'. 2023-10-10 07:42:31,769 - 4387 INFO [flink-file-cache-thread-1] org.apache.flink.runtime.blob.BlobClient:Downloading fdfedae63334afa922a44c7b4120366a/p-f24ece52a1c2453004efc4fa09a2e51e457a117c-b355907063f2415601601ed94c48df3a from localhost/127.0.0.1:23110 2023-10-10 07:42:31,769 - 4387 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Obtaining local cache file for 'class_path_0'. 2023-10-10 07:42:32,025 - 4643 INFO [flink-file-cache-thread-2] org.apache.flink.runtime.blob.BlobClient:Downloading fdfedae63334afa922a44c7b4120366a/p-7249c42f01da62108d3cce60d15de37637580a11-53304a2ed0210f590d6e4c1b9475df26 from localhost/127.0.0.1:23110 2023-10-10 07:42:32,028 - 4646 INFO [flink-file-cache-thread-3] org.apache.flink.runtime.blob.BlobClient:Downloading fdfedae63334afa922a44c7b4120366a/p-11c0cbd77e54fe526d0d8d3dc0eab81a48ef0687-7d77aa1b2253dc12f7b7a6b114ca4ebc from localhost/127.0.0.1:23110 2023-10-10 07:42:32,036 - 4654 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.state.StateBackendLoader:No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) 2023-10-10 07:42:32,041 - 4659 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.taskmanager.Task:Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0 (c8706b97efab23b2d6030fbc8dc1f9e3) switched from DEPLOYING to RUNNING. 2023-10-10 07:42:32,043 - 4661 INFO [flink-akka.actor.default-dispatcher-5] org.apache.flink.runtime.executiongraph.Execution:Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1) (c8706b97efab23b2d6030fbc8dc1f9e3) switched from DEPLOYING to RUNNING. 2023-10-10 07:42:32,059 - 4677 WARN [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.metrics.groups.TaskMetricGroup:The operator name Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) exceeded the 80 characters length limit and was truncated. 2023-10-10 07:42:32,067 - 4685 WARN [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] org.apache.flink.runtime.metrics.groups.TaskMetricGroup:The operator name Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) exceeded the 80 characters length limit and was truncated. 2023-10-10 07:42:32,088 - 4706 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.sink.DtOutputFormatSinkFunction:Start initialize output format state 2023-10-10 07:42:32,111 - 4729 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.sink.DtOutputFormatSinkFunction:Is restored:false 2023-10-10 07:42:32,112 - 4730 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.sink.DtOutputFormatSinkFunction:End initialize output format state 2023-10-10 07:42:32,262 - 4880 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.sink.format.BaseRichOutputFormat:[StreamOutputFormat] open successfully, checkpointMode = AT_LEAST_ONCE, checkpointEnabled = false, flushIntervalMills = 10000, batchSize = 1, [StreamConf]: { "semantic" : "at-least-once", "errorRecord" : 0, "checkFormat" : true, "column" : [ { "name" : "id", "notNull" : false, "part" : false }, { "name" : "age", "notNull" : false, "part" : false }, { "name" : "cname", "notNull" : false, "part" : false }, { "name" : "sale_amt", "notNull" : false, "part" : false }, { "name" : "ttime", "notNull" : false, "part" : false } ], "executeDdlAble" : false, "errorPercentage" : -1, "flushIntervalMills" : 10000, "fieldNameList" : [ ], "print" : true, "permitsPerSecond" : 0, "batchSize" : 1, "speedBytes" : 0, "rowSizeCalculatorType" : "objectSizeCalculator", "metricPluginName" : "prometheus" } 2023-10-10 07:42:32,262 - 4880 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.source.DtInputFormatSourceFunction:Start initialize input format state, is restored:false 2023-10-10 07:42:32,263 - 4881 INFO [Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.source.DtInputFormatSourceFunction:End initialize input format state 2023-10-10 07:42:32,272 - 4890 INFO [Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.connector.sqlservercdc.inputFormat.SqlServerCdcInputFormat:sqlServer cdc openInternal split number:0 start... 2023-10-10 07:42:32,318 - 4936 INFO [Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.connector.sqlservercdc.inputFormat.SqlServerCdcInputFormat:SqlserverCdcInputFormat[Flink_Job]open: end 2023-10-10 07:42:32,318 - 4936 INFO [cdcListener-pool-0] com.dtstack.chunjun.connector.sqlservercdc.listener.SqlServerCdcListener:SqlServerCdcListener start running..... 2023-10-10 07:42:32,325 - 4943 INFO [Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog, default_database, test2]], fields=[id, age, cname, sale_amt, ttime]) -> Sink: Sink(table=[default_catalog.default_database.sink], fields=[id, age, cname, sale_amt, ttime]) (1/1)#0] com.dtstack.chunjun.source.format.BaseRichInputFormat:[SqlServerCdcInputFormat] open successfully, inputSplit = GenericSplit (0/1), [SqlServerCdcConf]: { "semantic" : "at-least-once", "databaseName" : "GISS_TEST", "errorRecord" : 0, "checkFormat" : true, "parallelism" : 1, "executeDdlAble" : false, "errorPercentage" : -1, "flushIntervalMills" : 10000, "fieldNameList" : [ ], "url" : "jdbc:sqlserver://172.16.51.141:1433;databaseName=GISS_TEST", "pavingData" : true, "password" : "*****", "pollInterval" : 1000, "splitUpdate" : false, "cat" : "insert,delete,update", "tableList" : [ "dbo.test2" ], "timestampFormat" : "sql", "autoResetConnection" : false, "batchSize" : 1, "autoCommit" : false, "speedBytes" : 0, "rowSizeCalculatorType" : "objectSizeCalculator", "metricPluginName" : "prometheus", "username" : "sa" }

Anything else

No response

Version

master

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Oct 09 '23 23:10 waryars