Exchangis icon indicating copy to clipboard operation
Exchangis copied to clipboard

[Bug] exchangis start duplicated engine error and import

Open ryze124 opened this issue 9 months ago • 1 comments

Search before asking

  • [X] I searched the issues and found no similar issues.

Exchangis Component

exchangis-job-server

What happened + What you expected to happen

  1. after submited a datax job,linkis started 2 linkis-datax engines and the import data was double;
  • my job image
  • linkis-datax engine: image
  • source data image
  • imported data image
  1. 1 linkis-datax engine , 1 data
  2. job log
2024-04-29 13:27:08.228 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Init to create launched job and begin generating
2.   2024-04-29 13:27:08.260 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Fetch data source parameters in [MYSQL]
3.   2024-04-29 13:27:08.280 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Fetch data source parameters in [HIVE]
4.   2024-04-29 13:27:08.477 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Datax-code built complete, output: {
5.     "content" : [ {
6.       "transformer" : [ ],
7.       "reader" : {
8.         "name" : "mysqlreader",
9.         "parameter" : {
10.           "column" : [ {
11.             "name" : "id",
12.             "type" : "INT",
13.             "index" : "0"
14.           }, {
15.             "name" : "name",
16.             "type" : "VARCHAR",
17.             "index" : "1"
18.           }, {
19.             "name" : "create_time",
20.             "type" : "DATETIME",
21.             "index" : "2"
22.           } ],
23.           "connection" : [ {
24.             "jdbcUrl" : [ {
25.               "host" : "xx.xx.x.xxx",
26.               "port" : "3306",
27.               "database" : "test"
28.             } ],
29.             "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
30.           } ],
31.           "where" : "",
32.           "username" : "root"
33.         }
34.       },
35.       "writer" : {
36.         "name" : "hdfswriter",
37.         "parameter" : {
38.           "fileName" : "exch_hive_",
39.           "nullFormat" : "",
40.           "compress" : "GZIP",
41.           "column" : [ {
42.             "name" : "id",
43.             "type" : "bigint",
44.             "index" : "0"
45.           }, {
46.             "name" : "name",
47.             "type" : "string",
48.             "index" : "1"
49.           }, {
50.             "name" : "create_time",
51.             "type" : "string",
52.             "index" : "2"
54.           } ],
55.           "writeMode" : "append",
56.           "fieldDelimiter" : "\u0001",
57.           "encoding" : "utf-8",
58.           "hiveTable" : "test_datax2004",
59.           "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
60.           "hiveMetastoreUris" : "thrift://xx.xxx.xx.xx:9083",
61.           "hadoopConfig" : {
62.             "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
63.             "fs.defaultFS" : "hdfs://nameservice1",
64.             "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx:8020",
65.             "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxx:8020",
66.             "dfs.nameservices" : "nameservice1",
67.             "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
68.           },
69.           "defaultFS" : "hdfs://nameservice1",
70.           "fileType" : "TEXT",
71.           "hiveDatabase" : "hadoop_test"
72.         }
73.       }
74.     } ]
75.   }
76.   2024-04-29 13:27:08.495 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to generate launched job, output tasks [1]
77.   2024-04-29 13:27:08.519 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Submit the launchable task: [name:datax-test ,id:1996209572313960448 ] to launcher: [Linkis], retry_count: 0
78.   2024-04-29 13:27:08.530 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Submit the launchable task: [name:datax-test ,id:1996209572313960448 ] to launcher: [Linkis], retry_count: 0
79.   2024-04-29 13:27:31.578 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to submit task:[name:datax-test, id:1996209572313960448] to Linkis [linkis_id: 36_20_1c2f8a77-f12f-49e6-a502-6ea87fb15692linkis-cg-engineconniotdb-03.hostname.com:17840, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
80.   2024-04-29 13:27:31.607 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change to Running, info: []
81.   2024-04-29 13:27:32.283 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to submit task:[name:datax-test, id:1996209572313960448] to Linkis [linkis_id: 36_20_274fd827-5741-48cf-b960-d920beee23a1linkis-cg-engineconniotdb-03.hostname.com:3584, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
82.   2024-04-29 13:27:32.308 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change to Running, info: []
83.   2024-04-29 13:27:35.351 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
84.   2024-04-29 13:27:36.011 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
85.   2024-04-29 13:27:38.413 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
86.   2024-04-29 13:27:39.064 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
87.   2024-04-29 13:27:41.497 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
88.   2024-04-29 13:27:42.125 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
89.   2024-04-29 13:27:46.781 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Progress of task: [1996209572313960448] change 0.0 => 1.0
90.   2024-04-29 13:27:46.781 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change Running => Success
91.   2024-04-29 13:27:47.432 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change Running => Success

Relevent platform

  • centos 7.9
  • java version "1.8.0_333"
  • dss 1.1.2
  • linkis 1.4.0
  • exchangis 1.1.2

Reproduction script

  1. exchangis job image image

  2. exchangis log

2024-04-29 13:37:43.931 [INFO ] [qtp568168963-5448                       ] c.w.w.e.c.AuditLogUtils (33) [printLog] - [2024-04-29T13:37:43.930+0800],[hadoop],[proxyUser is: hadoop],[Exchangis-1.1.2],[job],[5835],[Job id is: 5835],[update],[Request(PUT //iotdb-03.hostname.com:8008/api/rest_j/v1/dss/exchangis/main/job/5835/content)@564dd9de]
2024-04-29 13:37:43.975 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.e.g.AbstractTaskGenerator (51) [init] - Generate job execution id: [5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] for job: [datax_9561]
2024-04-29 13:37:43.986 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.l.s.LocalSimpleJobLogService (244) [lambda$getOrCreateLogCache$1] - Create the new job log file: /data/bdp/dss/exchangis/main/logs/hadoop/2024-04-29/5095d23c-6a4b-48ae-b1d9-87ceb6503eaf
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.e.g.DefaultTaskGenerator (35) [info] - Init to create launched job and begin generating
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Init to create launched job and begin generating
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.s.i.DefaultJobExecuteService (297) [executeJob] - Submit the generation scheduler task: [5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] for job: [5835], tenancy: [hadoop] to TaskExecution
2024-04-29 13:37:43.994 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Inited => Scheduled.
2024-04-29 13:37:43.994 [INFO ] [qtp568168963-5337                       ] c.w.w.e.c.AuditLogUtils (33) [printLog] - [2024-04-29T13:37:43.994+0800],[hadoop],[proxyUser is: hadoop],[Exchangis-1.1.2],[job],[5835],[Execute task is: datax_9561],[execute],[Request(POST //iotdb-03.hostname.com:8008/api/rest_j/v1/dss/exchangis/main/job/5835/execute)@564dd9de]
2024-04-29 13:37:43.995 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Scheduled => Running.
2024-04-29 13:37:43.995 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (87) [buildJob] - To parse content ExchangisJob: id: [5835], name: [datax_9561], expect subJobs: [1]
2024-04-29 13:37:43.996 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (101) [buildJob] - Invoke job handlers to handle the subJobs, ExchangisJob: id: [5835], name: [datax_9561]
2024-04-29 13:37:43.996 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (35) [info] - Fetch data source parameters in [MYSQL]
2024-04-29 13:37:43.997 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Fetch data source parameters in [MYSQL]
2024-04-29 13:37:44.003 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.d.s.ExchangisDataSourceService (1226) [getDataSourceConnectParamsById] - getDataSourceConnectParamsById userName:hadoop
2024-04-29 13:37:44.019 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/data-source-manager/2/connect-params?system=system taken: 15 ms.
2024-04-29 13:37:44.019 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (35) [info] - Fetch data source parameters in [HIVE]
2024-04-29 13:37:44.020 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Fetch data source parameters in [HIVE]
2024-04-29 13:37:44.020 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.d.s.ExchangisDataSourceService (1226) [getDataSourceConnectParamsById] - getDataSourceConnectParamsById userName:hadoop
2024-04-29 13:37:44.032 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/data-source-manager/6/connect-params?system=system taken: 12 ms.
2024-04-29 13:37:44.168 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadatamanager/partitions/6/db/hadoop_test/table/test_datax2004?system=exchangis taken: 135 ms.
2024-04-29 13:37:44.213 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadatamanager/props/6/db/hadoop_test/table/test_datax2004?system=exchangis taken: 44 ms.
2024-04-29 13:37:44.230 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadataQuery/getConnectionInfo?system=exchangis&uri=hdfs%3A%2F%2Fnameservice1%2Fuser%2Fhadoop%2Fhadoop_test.db%2Ftest_datax2004&dataSourceName=.LOCAL_HDFS taken: 15 ms.
2024-04-29 13:37:44.231 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.e.DataxExchangisEngineJobBuilder (35) [info] - Datax-code built complete, output: {
  "content" : [ {
    "transformer" : [ ],
    "reader" : {
      "name" : "mysqlreader",
      "parameter" : {
        "column" : [ {
          "name" : "id",
          "type" : "INT",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "VARCHAR",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "DATETIME",
          "index" : "2"
        } ],
        "password" : "xxxxxx",
        "connection" : [ {
          "jdbcUrl" : [ {
            "host" : "xxxxx",
            "port" : "3306",
            "database" : "test"
          } ],
          "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
        } ],
        "where" : "",
        "username" : "root"
      }
    },
    "writer" : {
      "name" : "hdfswriter",
      "parameter" : {
        "fileName" : "exch_hive_",
        "nullFormat" : "",
        "compress" : "GZIP",
        "column" : [ {
          "name" : "id",
          "type" : "bigint",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "string",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "string",
          "index" : "2"
        } ],
        "writeMode" : "append",
        "fieldDelimiter" : "\u0001",
        "encoding" : "utf-8",
        "hiveTable" : "test_datax2004",
        "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
        "hiveMetastoreUris" : "thrift://xxxxxxxx:9083",
        "hadoopConfig" : {
          "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
          "fs.defaultFS" : "hdfs://nameservice1",
          "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx.hadoop.com:8020",
          "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxxxxxxxxxxxxxx:8020",
          "dfs.nameservices" : "nameservice1",
          "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
        },
        "defaultFS" : "hdfs://nameservice1",
        "fileType" : "TEXT",
        "hiveDatabase" : "hadoop_test"
      }
    }
  } ]
}
2024-04-29 13:37:44.231 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Datax-code built complete, output: {
  "content" : [ {
    "transformer" : [ ],
    "reader" : {
      "name" : "mysqlreader",
      "parameter" : {
        "column" : [ {
          "name" : "id",
          "type" : "INT",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "VARCHAR",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "DATETIME",
          "index" : "2"
        } ],
        "password" : "xxxxxxxxxxxxxxxxxxxxxxx",
        "connection" : [ {
          "jdbcUrl" : [ {
            "host" : "xx.xx.xx.xx",
            "port" : "3306",
            "database" : "test"
          } ],
          "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
        } ],
        "where" : "",
        "username" : "root"
      }
    },
    "writer" : {
      "name" : "hdfswriter",
      "parameter" : {
        "fileName" : "exch_hive_",
        "nullFormat" : "",
        "compress" : "GZIP",
        "column" : [ {
          "name" : "id",
          "type" : "bigint",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "string",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "string",
          "index" : "2"
        } ],
        "writeMode" : "append",
        "fieldDelimiter" : "\u0001",
        "encoding" : "utf-8",
        "hiveTable" : "test_datax2004",
        "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
        "hiveMetastoreUris" : "thrift://xx.xxx.xx.xx:9083",
        "hadoopConfig" : {
          "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
          "fs.defaultFS" : "hdfs://nameservice1",
          "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx.hadoop.com:8020",
          "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxx.hadoop.com:8020",
          "dfs.nameservices" : "nameservice1",
          "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
        },
        "defaultFS" : "hdfs://nameservice1",
        "fileType" : "TEXT",
        "hiveDatabase" : "hadoop_test"
      }
    }
  } ]
}
2024-04-29 13:37:44.232 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.l.b.LinkisExchangisLauncherJobBuilder (60) [buildJob] - Use the engine resources: [{"engineType":"datax","id":null,"name":"mysqlreader.zip","type":"bml","path":"/datax/plugin/reader/mysqlreader","createTime":1711440244000,"modifyTime":1711440244000,"creator":"hadoop","resourceId":"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9","version":"v000001","inputStream":null,"uri":"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001"},{"engineType":"datax","id":null,"name":"hdfswriter.zip","type":"bml","path":"/datax/plugin/writer/hdfswriter","createTime":1711440290000,"modifyTime":1711440290000,"creator":"hadoop","resourceId":"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066","version":"v000001","inputStream":null,"uri":"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001"}] for job/task: [datax-test]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.g.DefaultTaskGenerator (35) [info] - Success to generate launched job, output tasks [1]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to generate launched job, output tasks [1]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Running => Succeed.
2024-04-29 13:37:44.251 [INFO ] [Observe-Thread-NewInTaskObserver        ] c.w.w.e.j.s.e.s.NewInTaskObserver (34) [onPublishNext] - Get the launchable task from database, size: [1]
2024-04-29 13:37:44.267 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Inited => Scheduled.
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Scheduled => Running.
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.278 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Inited => Scheduled.
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Scheduled => Running.
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:45.058 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/bml/upload taken: 788 ms.
2024-04-29 13:37:45.059 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (118) [doSubmit] - Ready to create a engineConn: {"createService":"exchangis","ignoreTimeout":true,"properties":{"wds.linkis.engineconn.datax.bml.resources":"[{\"engineType\":\"datax\",\"id\":null,\"name\":\"mysqlreader.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/reader/mysqlreader\",\"createTime\":1711440244000,\"modifyTime\":1711440244000,\"creator\":\"hadoop\",\"resourceId\":\"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001\"},{\"engineType\":\"datax\",\"id\":null,\"name\":\"hdfswriter.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/writer/hdfswriter\",\"createTime\":1711440290000,\"modifyTime\":1711440290000,\"creator\":\"hadoop\",\"resourceId\":\"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001\"}]","_datax_.setting.speed.channel":"1","_datax_.setting.speed.byte":5242880,"wds.linkis.engineconn.java.driver.memory":"1024MB","_datax_.setting.speed.record":"100","_datax_.setting.errorLimit.record":"","label.codeType":null,"_datax_.setting.max.memory":"1024","wds.linkis.engineconn.datax.execution.id":1996212238863699968,"onceExecutorContent":"resource_036587d8f85-24f7-47f5-b53a-463c1deb5063v000001"},"timeout":30000,"labels":{"userCreator":"hadoop-exchangis","engineType":"datax-3.0.0","engineConnMode":"once"}}.
2024-04-29 13:37:45.068 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/bml/upload taken: 788 ms.
2024-04-29 13:37:45.069 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (118) [doSubmit] - Ready to create a engineConn: {"createService":"exchangis","ignoreTimeout":true,"properties":{"wds.linkis.engineconn.datax.bml.resources":"[{\"engineType\":\"datax\",\"id\":null,\"name\":\"mysqlreader.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/reader/mysqlreader\",\"createTime\":1711440244000,\"modifyTime\":1711440244000,\"creator\":\"hadoop\",\"resourceId\":\"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001\"},{\"engineType\":\"datax\",\"id\":null,\"name\":\"hdfswriter.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/writer/hdfswriter\",\"createTime\":1711440290000,\"modifyTime\":1711440290000,\"creator\":\"hadoop\",\"resourceId\":\"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001\"}]","_datax_.setting.speed.channel":"1","_datax_.setting.speed.byte":5242880,"wds.linkis.engineconn.java.driver.memory":"1024MB","_datax_.setting.speed.record":"100","_datax_.setting.errorLimit.record":"","label.codeType":null,"_datax_.setting.max.memory":"1024","wds.linkis.engineconn.datax.execution.id":1996212238863699968,"onceExecutorContent":"resource_036a3c662b1-3f16-43cb-bf9f-2b9f0c6b3971v000001"},"timeout":30000,"labels":{"userCreator":"hadoop-exchangis","engineType":"datax-3.0.0","engineConnMode":"once"}}.
2024-04-29 13:37:45.428 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/createEngineConn taken: 369 ms.
2024-04-29 13:37:45.429 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (126) [doSubmit] - EngineConn created with status Starting, the nodeInfo is {managerServiceInstance={instance=iotdb-03.hostname.com:9101, applicationName=linkis-cg-linkismanager}, ecAsyncStartResult=success, ecmServiceInstance={instance=iotdb-03.hostname.com:9102, applicationName=linkis-cg-engineconnmanager}, serviceInstance={instance=iotdb-03.hostname.com:20175, applicationName=linkis-cg-engineconn}, nodeStatus=Starting, ticketId=8a6f79df-ceb4-43e1-8e4a-ba861015d4bb}.
2024-04-29 13:37:45.429 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (130) [doSubmit] - Wait for EngineConn ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175) to be running or completed.
2024-04-29 13:37:45.439 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.548 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.759 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/createEngineConn taken: 849 ms.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (126) [doSubmit] - EngineConn created with status Starting, the nodeInfo is {managerServiceInstance={instance=iotdb-03.hostname.com:9101, applicationName=linkis-cg-linkismanager}, ecAsyncStartResult=success, ecmServiceInstance={instance=iotdb-03.hostname.com:9102, applicationName=linkis-cg-engineconnmanager}, serviceInstance={instance=iotdb-03.hostname.com:24775, applicationName=linkis-cg-engineconn}, nodeStatus=Starting, ticketId=e379222c-bcbc-488e-9fbe-063b81d8eb65}.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (130) [doSubmit] - Wait for EngineConn ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775) to be running or completed.
2024-04-29 13:37:45.930 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:46.042 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.069 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:46.254 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.482 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.543 [INFO ] [qtp568168963-5348                       ] c.w.w.e.j.s.l.s.LocalSimpleJobLogService (174) [logsFromPageAndPath] - have error information
2024-04-29 13:37:46.565 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:46.977 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.993 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:47.489 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:47.604 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.102 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.315 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.816 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 12 ms.
2024-04-29 13:37:49.126 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:49.635 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 19 ms.
2024-04-29 13:37:50.048 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 21 ms.
2024-04-29 13:37:50.568 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 27 ms.
2024-04-29 13:37:51.059 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:51.579 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:52.169 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:52.689 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:53.380 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:53.920 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:37:54.949 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:37:55.408 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 17 ms.
2024-04-29 13:37:56.390 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 33 ms.
2024-04-29 13:37:56.835 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 20 ms.
2024-04-29 13:37:58.064 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 45 ms.
2024-04-29 13:37:58.494 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 21 ms.
2024-04-29 13:37:59.836 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 14 ms.
2024-04-29 13:38:00.362 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 45 ms.
2024-04-29 13:38:01.569 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:38:02.287 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 223 ms.
2024-04-29 13:38:03.396 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 20 ms.
2024-04-29 13:38:04.165 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 31 ms.
2024-04-29 13:38:05.586 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 25 ms.
2024-04-29 13:38:06.082 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 15 ms.
2024-04-29 13:38:07.659 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:38:07.660 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (133) [doSubmit] - EngineConn of ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175) is in Running.
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_8a6f79df-ceb4-43e1-8e4a-ba861015d4bblinkis-cg-engineconniotdb-03.hostname.com:20175, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_8a6f79df-ceb4-43e1-8e4a-ba861015d4bblinkis-cg-engineconniotdb-03.hostname.com:20175, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:07.744 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:07.745 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:07.755 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Running => Succeed.
2024-04-29 13:38:08.091 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:38:08.092 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (133) [doSubmit] - EngineConn of ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775) is in Running.
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 8 ms.
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_e379222c-bcbc-488e-9fbe-063b81d8eb65linkis-cg-engineconniotdb-03.hostname.com:24775, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_e379222c-bcbc-488e-9fbe-063b81d8eb65linkis-cg-engineconniotdb-03.hostname.com:24775, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:08.123 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:08.124 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:08.126 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Running => Succeed.
2024-04-29 13:38:10.133 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:10.777 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 19 ms.
2024-04-29 13:38:10.777 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:11.361 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 128 ms.
2024-04-29 13:38:11.362 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:11.672 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 894 ms.
2024-04-29 13:38:11.673 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:11.731 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:12.115 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 752 ms.
2024-04-29 13:38:12.115 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:12.132 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:12.755 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_0-Status]
2024-04-29 13:38:12.766 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:12.766 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:12.786 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 19 ms.
2024-04-29 13:38:12.787 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:13.127 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_12-Status]
2024-04-29 13:38:13.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 3]
2024-04-29 13:38:13.137 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:13.138 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:13.167 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 29 ms.
2024-04-29 13:38:13.168 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:14.741 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:14.742 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:14.759 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 17 ms.
2024-04-29 13:38:14.760 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:14.771 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:15.143 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:15.144 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:15.161 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 17 ms.
2024-04-29 13:38:15.162 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:15.173 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:16.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:17.783 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:17.784 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:17.791 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_9-Status]
2024-04-29 13:38:17.800 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 16 ms.
2024-04-29 13:38:17.801 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:17.803 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:38:17.803 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:17.810 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:17.821 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 18 ms.
2024-04-29 13:38:17.822 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:18.170 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_8-Status]
2024-04-29 13:38:18.180 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 7 ms.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:18.197 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 16 ms.
2024-04-29 13:38:18.197 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:18.199 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 18 ms.
2024-04-29 13:38:18.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:18.208 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:19.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:20.820 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-13  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:21.217 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-12  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 7 ms.
2024-04-29 13:38:22.135 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:22.823 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_7-Status]
2024-04-29 13:38:22.844 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Progress of task: [1996212238863699968] change 0.0 => 1.0
2024-04-29 13:38:22.844 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Progress of task: [1996212238863699968] change 0.0 => 1.0
2024-04-29 13:38:22.845 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:22.845 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:23.199 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_3-Status]
2024-04-29 13:38:23.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:23.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success

Anything else

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

ryze124 avatar Apr 29 '24 05:04 ryze124