[Bug] [MySQL-CDC] Encounter NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()

Open gphwxhq opened this issue 1 year ago • 2 comments

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened

When I was synchronizing data for MYSQL5.7.40-log version using the 2.3.7 version of mysql-cdc component and I encountered a java.lang.NosuchMethodError: org.apache.setannel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssigning() error, the same script runs normally in version 2.3.5

SeaTunnel Version

2.3.7

SeaTunnel Config

{
  "env": {
    "job.mode": "STREAMING",
    "job.name": "SeaTunnel_Job"
  },

  "source": [
    {
      "snapshot.split.size": 8096,
      "snapshot.fetch.size": 1024,
      "incremental.parallelism": 1,
      "connect.timeout.ms": 30000,
      "connect.max-retries": 3,
      "connection.pool.size": 20,
      "chunk-key.even-distribution.factor.lower-bound": 0.05,
      "chunk-key.even-distribution.factor.upper-bound": 100,
      "sample-sharding.threshold": 1000,
      "inverse-sampling.rate": 1000,
      "startup.mode": "INITIAL",
      "exactly_once": "false",
      "stop.mode": "NEVER",
      "parallelism": 1,
      "result_table_name": "Table3942752403328",
      "catalog": {
        "factory": "Mysql"
      },
      "database-names": ["cdc_test"],
      "table-names": ["cdc_test.source"],
      "format": "DEFAULT",
      "base-url": "jdbc:mysql://localhost:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&",
      "password": "",
      "username": "",
      "plugin_name": "MySQL-CDC"
    }
  ],
  "transform": [],
  "sink": [
    {
      "schema_save_mode": "CREATE_SCHEMA_WHEN_NOT_EXIST",
      "data_save_mode": "APPEND_DATA",
      "create_index": "true",
      "connection_check_timeout_sec": 30,
      "batch_size": 1000,
      "is_exactly_once": "false",
      "max_commit_attempts": 3,
      "transaction_timeout_sec": -1,
      "max_retries": 0,
      "auto_commit": "true",
      "support_upsert_by_query_primary_key_exist": "false",
      "multi_table_sink_replica": 1,
      "source_table_name": "Table3942752403328",
      "generate_sink_sql": true,
      "database": "cdc_test",
      "table": "sink",
      "password": "",
      "driver": "com.mysql.cj.jdbc.Driver",
      "user": "root",
      "url": "jdbc:mysql://localhost:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&",
      "plugin_name": "Jdbc"
    }
  ]
}

Running Command

using submit api

Error Exception

2024-08-22 14:49:37,777 INFO [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel] [5.1] Received auth from Connection[id=4, /10.233.69.52:5801->/10.233.72.7:45441, qualifier=null, endpoint=[10.233.72.7]:45441, remoteUuid=e2c574c0-0de7-4297-aca4-b21bf1d47e01, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: e2c574c0-0de7-4297-aca4-b21bf1d47e01, client name: hz.client_1, client version: 5.1

2024-08-22 14:49:51,035 INFO [o.a.s.c.s.u.ConfigBuilder ] [hz.main.cached.thread-4] - Loading config file from objectMap

2024-08-22 14:49:51,087 INFO [o.a.s.c.s.u.ConfigShadeUtils ] [hz.main.cached.thread-4] - Load config shade spi: [base64]

2024-08-22 14:49:51,119 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - add common jar in plugins :[]

2024-08-22 14:49:51,130 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSink Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,137 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='MySQL-CDC'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar

2024-08-22 14:49:51,137 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar

2024-08-22 14:49:51,138 INFO [.c.c.DefaultClassLoaderService] [hz.main.cached.thread-4] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,141 WARN [o.a.s.a.c.u.ConfigUtil ] [hz.main.cached.thread-4] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.

2024-08-22 14:49:51,142 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all sources.

2024-08-22 14:49:51,655 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [hz.main.cached.thread-4] - Catalog MySQL established connection to jdbc:mysql://10.0.1.71:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&

2024-08-22 14:49:51,682 INFO [o.a.s.a.t.c.CatalogTableUtil ] [hz.main.cached.thread-4] - Get catalog tables, cost time: 27 ms

2024-08-22 14:49:51,686 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [hz.main.cached.thread-4] - Catalog MySQL closing

2024-08-22 14:49:51,756 INFO [o.a.s.a.t.f.FactoryUtil ] [hz.main.cached.thread-4] - get the CatalogTable from source MySQL-CDC: MySQL.cdc_test.source

2024-08-22 14:49:51,767 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSource Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,790 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='MySQL-CDC'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar

2024-08-22 14:49:51,792 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all transforms.

2024-08-22 14:49:51,792 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all sinks.

2024-08-22 14:49:51,792 WARN [o.a.s.a.c.u.ConfigUtil ] [hz.main.cached.thread-4] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.

2024-08-22 14:49:51,796 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSink Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,797 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar

2024-08-22 14:49:51,809 INFO [o.a.s.a.t.f.FactoryUtil ] [hz.main.cached.thread-4] - Create sink 'Jdbc' with upstream input catalog-table[database: cdc_test, schema: null, table: source]

2024-08-22 14:49:51,843 INFO [.c.c.DefaultClassLoaderService] [hz.main.cached.thread-4] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,964 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-1] - Init JobMaster for Job SeaTunnel_Job (878893716679426049)

2024-08-22 14:49:51,964 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) needed jar urls [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,964 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:52,093 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-1] - Catalog MySQL established connection to jdbc:mysql://10.0.1.71:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&

2024-08-22 14:49:52,106 INFO [a.s.a.s.SaveModeExecuteWrapper] [seatunnel-coordinator-service-1] - Executing save mode for table: cdc_test.sink, with SchemaSaveMode: CREATE_SCHEMA_WHEN_NOT_EXIST, DataSaveMode: APPEND_DATA using Catalog: MySQL

2024-08-22 14:49:52,108 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-1] - Catalog MySQL closing

2024-08-22 14:49:52,176 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:52,646 WARN [o.a.h.u.NativeCodeLoader ] [seatunnel-coordinator-service-1] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2024-08-22 14:49:52,968 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-1] - Create CheckpointCoordinator for job(1@878893716679426049) with plan(CheckpointPlan(pipelineId=1, pipelineSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=50000, index=0}], startingSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}], pipelineActions={ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink])=1}, subtaskActions={TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), -1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=50000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink]), 0)]}))

2024-08-22 14:49:52,970 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - The task Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] is in state CREATED when init state future

2024-08-22 14:49:52,971 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - The task Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] is in state CREATED when init state future

2024-08-22 14:49:52,974 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) state process is start

2024-08-22 14:49:52,976 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) turned from state CREATED to SCHEDULED.

2024-08-22 14:49:52,976 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] state process is start

2024-08-22 14:49:52,978 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state CREATED to SCHEDULED.

2024-08-22 14:49:52,995 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state SCHEDULED to DEPLOYING.

2024-08-22 14:49:52,996 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is start

2024-08-22 14:49:52,999 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state CREATED to DEPLOYING.

2024-08-22 14:49:53,013 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] received deploying task executionId [878893716679491585]

2024-08-22 14:49:53,019 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar]

2024-08-22 14:49:53,063 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, executionId [878893716679491585]

2024-08-22 14:49:53,063 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} init success

2024-08-22 14:49:53,068 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} success

2024-08-22 14:49:53,070 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,071 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] current state equals target state: RUNNING, skip

2024-08-22 14:49:53,071 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is start

2024-08-22 14:49:53,072 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-MySQL-CDC]

2024-08-22 14:49:53,074 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state CREATED to DEPLOYING.

2024-08-22 14:49:53,105 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] received deploying task executionId [878893716679557121]

2024-08-22 14:49:53,105 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:53,139 INFO [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel] [5.1] Received auth from Connection[id=6, /10.233.69.52:5801->/10.233.72.7:37373, qualifier=null, endpoint=[10.233.72.7]:37373, remoteUuid=912b2a52-e85e-4eaa-89c6-838317821982, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: 912b2a52-e85e-4eaa-89c6-838317821982, client name: hz.client_2, client version: 5.1

2024-08-22 14:49:53,155 WARN [i.d.c.m.MySqlConnection ] [hz.main.seaTunnel.task.thread-2] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,160 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, executionId [878893716679557121]

2024-08-22 14:49:53,161 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} init success

2024-08-22 14:49:53,162 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} success

2024-08-22 14:49:53,164 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,164 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] current state equals target state: RUNNING, skip

2024-08-22 14:49:53,165 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,166 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) turned from state SCHEDULED to RUNNING.

2024-08-22 14:49:53,182 INFO [s.e.s.t.TransformSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - starting seatunnel transform task, index 0

2024-08-22 14:49:53,203 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - Read list of available databases

2024-08-22 14:49:53,220 INFO [a.s.a.s.m.MultiTableSinkWriter] [hz.main.seaTunnel.task.thread-5] - init multi table sink writer, queue size: 1

2024-08-22 14:49:53,333 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - list of available databases is: [cdc_test]

2024-08-22 14:49:53,333 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - Read list of available tables in each database

2024-08-22 14:49:53,352 INFO [i.d.j.JdbcConnection ] [pool-8-thread-1] - Connection gracefully closed

2024-08-22 14:49:53,355 WARN [i.d.c.m.MySqlConnection ] [hz.main.seaTunnel.task.thread-2] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,386 INFO [i.d.j.JdbcConnection ] [pool-9-thread-1] - Connection gracefully closed

2024-08-22 14:49:53,392 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with remaining tables: [cdc_test.source]

2024-08-22 14:49:53,394 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with remaining splits: []

2024-08-22 14:49:53,394 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with assigned splits: []

2024-08-22 14:49:53,398 INFO [.a.s.e.s.t.SourceSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - starting seatunnel source task, index 0

2024-08-22 14:49:53,510 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Open Source Reader.

2024-08-22 14:49:53,517 INFO [.s.t.SourceSplitEnumeratorTask] [hz.main.seaTunnel.task.thread-2] - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}

2024-08-22 14:49:53,529 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - checkpoint is enabled, start schedule trigger pending checkpoint.

2024-08-22 14:49:53,620 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - received enough reader, starting enumerator...

2024-08-22 14:49:53,622 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@6442dd4e

java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z

at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:115) ~[?:?]

at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:156) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039) ~[seatunnel-starter.jar:2.3.7]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]

at java.lang.Thread.run(Thread.java:750) [?:1.8.0_333]

2024-08-22 14:49:53,622 WARN [i.d.c.m.MySqlConnection ] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,622 INFO [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Start splitting table cdc_test.source into chunks...

2024-08-22 14:49:53,622 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,622 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No primary key found for table cdc_test.source

2024-08-22 14:49:53,622 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] task 40000 error with exception: [java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z], cancel other task in taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}.

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No unique key found for table cdc_test.source

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No evenly split column found for table cdc_test.source

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No evenly split column found for table cdc_test.source, use single split org.apache.seatunnel.connectors.cdc.base.source.split.SnapshotSplit@9caef52f

2024-08-22 14:49:53,623 INFO [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Split table cdc_test.source into 1 chunks, time cost: 1ms.

2024-08-22 14:49:53,624 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] Interrupted task 50000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@2d446b60

2024-08-22 14:49:53,624 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 50000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,624 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:53,631 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Closing Source Reader.

2024-08-22 14:49:53,631 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,631 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,650 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} complete with FAILED

2024-08-22 14:49:53,651 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] task 50000 error with exception: [java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z], cancel other task in taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}.

2024-08-22 14:49:53,653 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel] [5.1] Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} complete with state FAILED

2024-08-22 14:49:53,655 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel] [5.1] Received task end from execution TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, state FAILED

2024-08-22 14:49:53,663 WARN [o.a.s.s.c.z.h.HikariConfig ] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - idleTimeout has been set but has no effect because the pool is operating as a fixed size pool.

2024-08-22 14:49:53,663 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Starting...

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state RUNNING to FAILED.

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is stopped

2024-08-22 14:49:53,666 ERROR [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] end with state FAILED and Exception: java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z

at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:115)

at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:156)

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127)

at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168)

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132)

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717)

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:750)

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] future complete with state FAILED

2024-08-22 14:49:53,666 ERROR [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} Failed in Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.

2024-08-22 14:49:53,668 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state RUNNING to FAILING.

2024-08-22 14:49:53,669 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-4] - release the task group resource TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,669 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is start

2024-08-22 14:49:53,670 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-41] - received slot release request, jobID: 878893716679426049, slot: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=878893716679426049, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='b7ecbb90-a077-42c8-8594-cdb83dd7d2bb'}

2024-08-22 14:49:53,670 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state RUNNING to CANCELING.

2024-08-22 14:49:53,676 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Send cancel Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] operator to member [localhost]:5801

2024-08-22 14:49:53,676 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-3] - [localhost]:5801 [seatunnel] [5.1] Task (TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}) need cancel.

2024-08-22 14:49:53,677 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is start

2024-08-22 14:49:53,700 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Start completed.

2024-08-22 14:49:53,717 INFO [.e.FieldNamedPreparedStatement] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - PrepareStatement sql is:

INSERT INTO `cdc_test`.`sink` (`id`, `name`, `address`, `tesi`) VALUES (?, ?, ?, ?)

2024-08-22 14:49:53,737 INFO [.JdbcMultiTableResourceManager] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - start close connection poolHikariPool-1

2024-08-22 14:49:53,737 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Shutdown initiated...

2024-08-22 14:49:53,741 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Shutdown completed.

2024-08-22 14:49:55,637 ERROR [e.s.t.o.s.AssignSplitOperation] [hz.main.generic-operation.thread-40] - [localhost]:5801 [seatunnel] [5.1] task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at org.apache.seatunnel.engine.server.TaskExecutionService.getActiveExecutionContext(TaskExecutionService.java:247) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService.getTask(TaskExecutionService.java:313) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.lambda$run$0(AssignSplitOperation.java:57) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.run(AssignSplitOperation.java:54) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.7]

2024-08-22 14:49:55,641 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@7cd5c766

java.util.concurrent.CompletionException: org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at com.hazelcast.spi.impl.AbstractInvocationFuture.returnOrThrowWithJoinConventions(AbstractInvocationFuture.java:819) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.AbstractInvocationFuture.resolveAndThrowWithJoinConvention(AbstractInvocationFuture.java:835) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.AbstractInvocationFuture.join(AbstractInvocationFuture.java:553) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.context.SeaTunnelSplitEnumeratorContext.assignSplit(SeaTunnelSplitEnumeratorContext.java:86) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.api.source.SourceSplitEnumerator$Context.assignSplit(SourceSplitEnumerator.java:102) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.assignSplits(IncrementalSourceEnumerator.java:176) ~[?:?]

at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.run(IncrementalSourceEnumerator.java:70) ~[?:?]

at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:319) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:138) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039) ~[seatunnel-starter.jar:2.3.7]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]

at java.lang.Thread.run(Thread.java:750) [?:1.8.0_333]

Caused by: org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at org.apache.seatunnel.engine.server.TaskExecutionService.getActiveExecutionContext(TaskExecutionService.java:247) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService.getTask(TaskExecutionService.java:313) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.lambda$run$0(AssignSplitOperation.java:57) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.run(AssignSplitOperation.java:54) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.7]

2024-08-22 14:49:55,641 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}

2024-08-22 14:49:55,641 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar]

2024-08-22 14:49:55,645 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}

2024-08-22 14:49:55,649 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} complete with CANCELED

2024-08-22 14:49:55,650 INFO [.e.IncrementalSourceEnumerator] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Closing enumerator...

2024-08-22 14:49:55,650 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-3] - [localhost]:5801 [seatunnel] [5.1] Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} complete with state CANCELED

2024-08-22 14:49:55,650 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-3] - [localhost]:5801 [seatunnel] [5.1] Received task end from execution TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, state CANCELED

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state CANCELING to CANCELED.

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is stopped

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] future complete with state CANCELED

2024-08-22 14:49:55,654 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - start clean pending checkpoint cause Pipeline turn to end state.

2024-08-22 14:49:55,657 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - Turn checkpoint_state_878893716679426049_1 state from null to CANCELED

2024-08-22 14:49:55,658 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] will end with state FAILED

2024-08-22 14:49:55,660 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state FAILING to FAILED.

Zeta or Flink or Spark Version

Zeta 2.3.7

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Aug 22 '24 08:08 gphwxhq

The CPU of DS923+ is AMD Ryzen R1600, the driver must be compiled for this CPU, otherwise it will not work.

Sep 11 '24 16:09 transformcube

Did you try full re-installation? https://github.com/bb-qq/r8152/wiki/Troubleshooting#uninstall-completely--full-reinstallation

If your issue is not resolved, please submit logs described below: https://github.com/bb-qq/r8152/wiki/Troubleshooting#how-to-investigate-if-the-driver-does-not-work-properly

Sep 18 '24 14:09 bb-qq

Since there has been no response for a long time, this issue is closed. Please feel free to re-open it.

Jan 02 '25 06:01 bb-qq