Flinkx1.12 并发执行异常（mysql 同步 hive）

Open biandou1313 opened this issue 3 years ago • 5 comments

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened

我开启20个并发，项目已启动 flinkx 子任务就已经完成18个还剩2个一直在运行

What you expected to happen

flinkx 20个子任务同时运行配置文件： jobmanager.rpc.address: localhost jobmanager.rpc.port: 6123 jobmanager.memory.process.size: 4096m taskmanager.memory.process.size: 8192m #jobmanager.memory.process.size: 16384m #taskmanager.memory.process.size: 32768m taskmanager.numberOfTaskSlots: 20 parallelism.default: 3 #jobmanager.execution.failover-strategy: region restart-strategy: none #restart-strategy: failure-rate #restart-strategy.failure-rate.max-failures-per-interval: 3 #restart-strategy.failure-rate.failure-rate-interval: 5 min #restart-strategy.failure-rate.delay: 10 s

heartbeat.timeout: 1800000

rest.bind-port: 50031-50040 #断点续传的环境准备 state.checkpoints.dir: hdfs://hadoop02:8020/checkpoints/metadata state.checkpoints.num-retained: 10

与 Prometheus 集成配置

metrics.reporter.promgateway.class: org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter

这里写PushGateway的主机名与端口号

#metrics.reporter.promgateway.host: pushgateway.software.dc metrics.reporter.promgateway.host: 172.18.8.211 #metrics.reporter.promgateway.port: 9091 metrics.reporter.promgateway.port: 9091

Flink metric在前端展示的标签（前缀）与随机后缀

metrics.reporter.promgateway.jobName: flink-metrics metrics.reporter.promgateway.randomJobNameSuffix: true metrics.reporter.promgateway.deleteOnShutdown: false metrics.reporter.promgateway.interval: 30 SECONDS

How to reproduce

{ "job": { "content": [{ "reader": { "parameter": { "password": "123456", "dataSourceId": 14, "column": [{ "precision": 20, "name": "id", "columnDisplaySize": 20, "type": "BIGINT" }, { "precision": 32, "name": "device_id", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 12, "name": "point", "columnDisplaySize": 12, "type": "VARCHAR" }, { "precision": 32, "name": "hash", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 32, "name": "value", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 19, "name": "acq_time", "columnDisplaySize": 19, "type": "DATETIME" }, { "precision": 12, "name": "ratio", "columnDisplaySize": 12, "type": "FLOAT" }, { "precision": 32, "name": "max_val", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 32, "name": "min_val", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 32, "name": "out_param", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 8, "name": "item_code", "columnDisplaySize": 8, "type": "VARCHAR" }, { "precision": 32, "name": "descr", "columnDisplaySize": 32, "type": "VARCHAR" }, { "precision": 16, "name": "save_hst", "columnDisplaySize": 16, "type": "SMALLINT" }, { "precision": 1, "name": "del_flag", "columnDisplaySize": 1, "type": "TINYINT" }, { "precision": 20, "name": "create_user", "columnDisplaySize": 20, "type": "BIGINT" }, { "precision": 20, "name": "update_user", "columnDisplaySize": 20, "type": "BIGINT" }, { "precision": 19, "name": "create_time", "columnDisplaySize": 19, "type": "DATETIME" }, { "precision": 19, "name": "update_time", "columnDisplaySize": 19, "type": "DATETIME" }, { "precision": 50, "name": "ext_first", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_second", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_third", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_fourth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_fifth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_sixth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_seventh", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_eighth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_ninth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "ext_tenth", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 50, "name": "device_add_id", "columnDisplaySize": 50, "type": "VARCHAR" }, { "precision": 8, "name": "today_start_value", "columnDisplaySize": 10, "type": "DECIMAL" }, { "precision": 75, "name": "unit", "columnDisplaySize": 75, "type": "VARCHAR" }], "connection": [{ "jdbcUrl": ["jdbc:mysql://172.18.8.209:3306/Vasyslink_yag001?useSSL=false&useUnicode=true&characterEncoding=utf8&useCursorFetch=true"], "table": ["tb_device_point_data_hst_01"] }],

				"splitPk": "id",
				"username": "root"
			},
			"name": "mysqlreader"
		},
		"writer": {
			"parameter": {
				"tablesColumn": "{\"tb_device_point_data_hst_920\":[{\"key\":\"id\",\"type\":\"bigint\",\"precision\":19,\"columnDisplaySize\":20},{\"key\":\"device_id\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"point\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"hash\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"value\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"acq_time\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ratio\",\"type\":\"float\",\"precision\":7,\"columnDisplaySize\":24},{\"key\":\"max_val\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"min_val\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"out_param\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"item_code\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"descr\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"save_hst\",\"type\":\"smallint\",\"precision\":5,\"columnDisplaySize\":6},{\"key\":\"del_flag\",\"type\":\"tinyint\",\"precision\":3,\"columnDisplaySize\":4},{\"key\":\"create_user\",\"type\":\"bigint\",\"precision\":19,\"columnDisplaySize\":20},{\"key\":\"update_user\",\"type\":\"bigint\",\"precision\":19,\"columnDisplaySize\":20},{\"key\":\"create_time\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"update_time\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_first\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_second\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_third\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_fourth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_fifth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_sixth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_seventh\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_eighth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_ninth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"ext_tenth\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"device_add_id\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647},{\"key\":\"today_start_value\",\"type\":\"decimal\",\"precision\":8,\"columnDisplaySize\":10},{\"key\":\"unit\",\"type\":\"string\",\"precision\":2147483647,\"columnDisplaySize\":2147483647}]}",
				"dataSourceId": 54,
				"partition": "pt",
				"jdbcUrl": "jdbc:hive2://172.18.8.208:10000/Vasyslink_yag001",
				"defaultFS": "hdfs://172.18.8.207:8020",
				"writeMode": "overwrite",
				"maxFileSize": 1073741824,
	
				"fieldDelimiter": "\t",
			
				"partitionType": "USERDEFINED",
                      "partitionValue": "2022",
				"fileType": "text",
				"charsetName": "UTF-8"
			},
			"name": "hivewriter"
		}
	}],
	"setting": {
		"log": {
			"isLogger": false
		},
		"errorLimit": {},
		"speed": {

			"channel": 20
		}
	}
}

}

Anything else

No response

Version

1.12_release

Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Aug 12 '22 01:08 biandou1313

09:37:27.169 [cluster-io-thread-1] INFO com.dtstack.flinkx.connector.jdbc.source.JdbcInputFormat - createInputSplitsInternal success, splits is [ { "mod": 0, "startLocationOfSplit": "1", "endLocationOfSplit": "6172840374662", "partitionNumber": 0, "totalNumberOfPartitions": 20 }, { "mod": 1, "startLocationOfSplit": "6172840374662", "endLocationOfSplit": "12345680749323", "partitionNumber": 1, "totalNumberOfPartitions": 20 }, { "mod": 2, "startLocationOfSplit": "12345680749323", "endLocationOfSplit": "18518521123984", "partitionNumber": 2, "totalNumberOfPartitions": 20 }, { "mod": 3, "startLocationOfSplit": "18518521123984", "endLocationOfSplit": "24691361498644", "partitionNumber": 3, "totalNumberOfPartitions": 20 }, { "mod": 4, "startLocationOfSplit": "24691361498644", "endLocationOfSplit": "30864201873304", "partitionNumber": 4, "totalNumberOfPartitions": 20 }, { "mod": 5, "startLocationOfSplit": "30864201873304", "endLocationOfSplit": "37037042247964", "partitionNumber": 5, "totalNumberOfPartitions": 20 }, { "mod": 6, "startLocationOfSplit": "37037042247964", "endLocationOfSplit": "43209882622624", "partitionNumber": 6, "totalNumberOfPartitions": 20 }, { "mod": 7, "startLocationOfSplit": "43209882622624", "endLocationOfSplit": "49382722997284", "partitionNumber": 7, "totalNumberOfPartitions": 20 }, { "mod": 8, "startLocationOfSplit": "49382722997284", "endLocationOfSplit": "55555563371944", "partitionNumber": 8, "totalNumberOfPartitions": 20 }, { "mod": 9, "startLocationOfSplit": "55555563371944", "endLocationOfSplit": "61728403746604", "partitionNumber": 9, "totalNumberOfPartitions": 20 }, { "mod": 10, "startLocationOfSplit": "61728403746604", "endLocationOfSplit": "67901244121264", "partitionNumber": 10, "totalNumberOfPartitions": 20 }, { "mod": 11, "startLocationOfSplit": "67901244121264", "endLocationOfSplit": "74074084495924", "partitionNumber": 11, "totalNumberOfPartitions": 20 }, { "mod": 12, "startLocationOfSplit": "74074084495924", "endLocationOfSplit": "80246924870584", "partitionNumber": 12, "totalNumberOfPartitions": 20 }, { "mod": 13, "startLocationOfSplit": "80246924870584", "endLocationOfSplit": "86419765245244", "partitionNumber": 13, "totalNumberOfPartitions": 20 }, { "mod": 14, "startLocationOfSplit": "86419765245244", "endLocationOfSplit": "92592605619904", "partitionNumber": 14, "totalNumberOfPartitions": 20 }, { "mod": 15, "startLocationOfSplit": "92592605619904", "endLocationOfSplit": "98765445994564", "partitionNumber": 15, "totalNumberOfPartitions": 20 }, { "mod": 16, "startLocationOfSplit": "98765445994564", "endLocationOfSplit": "104938286369224", "partitionNumber": 16, "totalNumberOfPartitions": 20 }, { "mod": 17, "startLocationOfSplit": "104938286369224", "endLocationOfSplit": "111111126743884", "partitionNumber": 17, "totalNumberOfPartitions": 20 }, { "mod": 18, "startLocationOfSplit": "111111126743884", "endLocationOfSplit": "117283967118544", "partitionNumber": 18, "totalNumberOfPartitions": 20 }, { "mod": 19, "startLocationOfSplit": "117283967118544", "partitionNumber": 19, "totalNumberOfPartitions": 20 } ] 09:37:27.170 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting ExecutionJobVertex cbc357ccb763df2852fee8c4fc7d55f2 (Source: mysqlsourcefactory -> Sink: hivesinkfactory) to 0 predecessors. 09:37:27.176 [cluster-io-thread-1] INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology - Built 20 pipelined regions in 1 ms 09:37:27.177 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Successfully created execution graph from job graph xxx11199 (2e9f246cf523737a1049a7b2830c723f). 09:37:27.188 [cluster-io-thread-1] INFO org.apache.flink.runtime.jobmaster.JobMaster - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'hdfs://hadoop02:8020/checkpoints/metadata', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) 09:37:27.195 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Searching Hadoop configuration files in Flink config: /opt/hadoop/hadoop-2.7.4/etc/hadoop 09:37:27.195 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/core-site.xml to hadoop configuration 09:37:27.196 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/hdfs-site.xml to hadoop configuration 09:37:27.196 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Searching Hadoop configuration files in HADOOP_CONF_DIR: /opt/hadoop/hadoop-2.7.4/etc/hadoop 09:37:27.196 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/core-site.xml to hadoop configuration 09:37:27.196 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/hdfs-site.xml to hadoop configuration 09:37:27.320 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.fs.hdfs.HadoopFsFactory - Instantiating for file system scheme hdfs Hadoop File System org.apache.hadoop.hdfs.DistributedFileSystem 09:37:27.341 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.client.impl.DfsClientConf - dfs.client.use.legacy.blockreader.local = false 09:37:27.341 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.client.impl.DfsClientConf - dfs.client.read.shortcircuit = false 09:37:27.341 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.client.impl.DfsClientConf - dfs.client.domain.socket.data.traffic = false 09:37:27.341 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.client.impl.DfsClientConf - dfs.domain.socket.path = 09:37:27.344 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.DFSClient - Sets dfs.client.block.write.replace-datanode-on-failure.min-replication to 0 09:37:27.513 [cluster-io-thread-1] DEBUG org.apache.hadoop.util.PerformanceAdvisory - Both short-circuit local reads and UNIX domain socket are disabled. 09:37:27.516 [cluster-io-thread-1] DEBUG org.apache.hadoop.hdfs.protocol.datatransfer.sasl.DataTransferSaslUtil - DataTransferProtocol not using SaslPropertiesResolver, no QOP found in configuration for dfs.data.transfer.protection 09:37:27.523 [cluster-io-thread-1] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Status of the shared state registry of job 2e9f246cf523737a1049a7b2830c723f after restore: SharedStateRegistry{registeredStates={}}. 09:37:27.523 [cluster-io-thread-1] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - No checkpoint found during restore. 09:37:27.524 [cluster-io-thread-1] INFO org.apache.flink.runtime.jobmaster.JobMaster - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@4afcc3 for xxx11199 (2e9f246cf523737a1049a7b2830c723f). 09:37:27.532 [cluster-io-thread-1] INFO org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl - JobManager runner for job xxx11199 (2e9f246cf523737a1049a7b2830c723f) was granted leadership with session id 00000000-0000-0000-0000-000000000000 at akka.tcp://flink@hadoop02:46635/user/rpc/jobmanager_2. 09:37:27.535 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Starting execution of job xxx11199 (2e9f246cf523737a1049a7b2830c723f) under job master id 00000000000000000000000000000000. 09:37:27.536 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 09:37:27.537 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job xxx11199 (2e9f246cf523737a1049a7b2830c723f) switched from state CREATED to RUNNING. 09:37:27.545 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: mysqlsourcefactory -> Sink: hivesinkfactory of job 2e9f246cf523737a1049a7b2830c723f is not in state RUNNING but SCHEDULED instead. Aborting checkpoint. 09:37:32.553 [flink-akka.actor.default-dispatcher-17] INFO org.apache.flink.yarn.YarnResourceManagerDriver - Received 1 containers. 09:37:32.554 [flink-akka.actor.default-dispatcher-17] INFO org.apache.flink.yarn.YarnResourceManagerDriver - Received 1 containers with priority 1, 1 pending container requests. 09:37:32.557 [flink-akka.actor.default-dispatcher-17] INFO org.apache.flink.yarn.YarnResourceManagerDriver - Removing container request Capability[<memory:8192, vCores:20>]Priority[1]. 09:37:32.557 [flink-akka.actor.default-dispatcher-17] INFO org.apache.flink.yarn.YarnResourceManagerDriver - Accepted 1 requested containers, returned 0 excess containers, 0 pending container requests of resource <memory:8192, vCores:20>. 09:37:32.558 [cluster-io-thread-4] INFO org.apache.flink.yarn.YarnResourceManagerDriver - TaskExecutor container_1660094185335_0105_01_000002(hadoop03:35769) will be started on hadoop03 with TaskExecutorProcessSpec {cpuCores=20.0, frameworkHeapSize=128.000mb (134217728 bytes), frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=3.225gb (3462817321 bytes), taskOffHeapSize=0 bytes, networkMemSize=711.680mb (746250577 bytes), managedMemorySize=2.780gb (2985002310 bytes), jvmMetaspaceSize=256.000mb (268435456 bytes), jvmOverheadSize=819.200mb (858993472 bytes)}. 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TaskManager configuration: {internal.jobgraph-path=job.graph, state.checkpoints.num-retained=10, metrics.reporter.promgateway.port=9091, classloader.check-leaked-classloader=false, metrics.reporter.promgateway.interval=30 SECONDS, metrics.reporter.promgateway.jobName=flink-metrics, high-availability.cluster-id=application_1660094185335_0105, jobmanager.rpc.address=hadoop02, jobmanager.memory.jvm-overhead.min=429496736b, metrics.reporter.promgateway.class=org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter, flink.checkpoint.interval=10000, rest.bind-port=50031-50040, parallelism.default=3, metrics.reporter.promgateway.randomJobNameSuffix=true, taskmanager.numberOfTaskSlots=20, yarn.application.name=xxx11199, yarn.application.queue=default, pluginLoadMode=shipfile, taskmanager.memory.process.size=8192m, taskmanager.resource-id=container_1660094185335_0105_01_000002, heartbeat.timeout=1800000, web.port=0, classloader.resolve-order=parent-first, jobmanager.memory.off-heap.size=134217728b, jobmanager.memory.process.size=4096m, web.tmpdir=/tmp/flink-web-1ff87434-812b-4e84-9885-99935c10025e, internal.taskmanager.resource-id.metadata=hadoop03:35769, jobmanager.rpc.port=46635, metrics.reporter.promgateway.deleteOnShutdown=false, internal.cluster.execution-mode=DETACHED, fs.hdfs.hadoopconf=/opt/hadoop/hadoop-2.7.4/etc/hadoop, rest.address=hadoop02, restart-strategy=none, jobmanager.memory.jvm-metaspace.size=268435456b, metrics.reporter.promgateway.host=172.18.8.211, jobmanager.memory.heap.size=3462817376b, state.checkpoints.dir=hdfs://hadoop02:8020/checkpoints/metadata, jobmanager.memory.jvm-overhead.max=429496736b} 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TM:remote keytab path obtained null 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TM:local keytab path obtained null 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TM:keytab principal obtained null 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TM:remote yarn conf path obtained null 09:37:32.560 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - TM:remote krb5 path obtained null 09:37:32.572 [cluster-io-thread-4] INFO org.apache.flink.yarn.YarnResourceManagerDriver - Creating container launch context for TaskManagers 09:37:32.574 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.clusterframework.BootstrapTools - TaskManager start command: $JAVA_HOME/bin/java -Xmx3597035049 -Xms3597035049 -XX:MaxDirectMemorySize=880468305 -XX:MaxMetaspaceSize=268435456 org.apache.flink.yarn.YarnTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=746250577b -D taskmanager.memory.network.min=746250577b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=2985002310b -D taskmanager.cpu.cores=20.0 -D taskmanager.memory.task.heap.size=3462817321b -D taskmanager.memory.task.off-heap.size=0b -D taskmanager.memory.jvm-metaspace.size=268435456b -D taskmanager.memory.jvm-overhead.max=858993472b -D taskmanager.memory.jvm-overhead.min=858993472b --configDir . -Djobmanager.rpc.address='hadoop02' -Djobmanager.memory.jvm-overhead.min='429496736b' -Dtaskmanager.resource-id='container_1660094185335_0105_01_000002' -Dweb.port='0' -Djobmanager.memory.off-heap.size='134217728b' -Dweb.tmpdir='/tmp/flink-web-1ff87434-812b-4e84-9885-99935c10025e' -Dinternal.taskmanager.resource-id.metadata='hadoop03:35769' -Djobmanager.rpc.port='46635' -Drest.address='hadoop02' -Djobmanager.memory.jvm-metaspace.size='268435456b' -Djobmanager.memory.heap.size='3462817376b' -Djobmanager.memory.jvm-overhead.max='429496736b' 1> <LOG_DIR>/taskmanager.out 2> <LOG_DIR>/taskmanager.err 09:37:32.574 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - Starting TaskManagers with command: $JAVA_HOME/bin/java -Xmx3597035049 -Xms3597035049 -XX:MaxDirectMemorySize=880468305 -XX:MaxMetaspaceSize=268435456 org.apache.flink.yarn.YarnTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=746250577b -D taskmanager.memory.network.min=746250577b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=2985002310b -D taskmanager.cpu.cores=20.0 -D taskmanager.memory.task.heap.size=3462817321b -D taskmanager.memory.task.off-heap.size=0b -D taskmanager.memory.jvm-metaspace.size=268435456b -D taskmanager.memory.jvm-overhead.max=858993472b -D taskmanager.memory.jvm-overhead.min=858993472b --configDir . -Djobmanager.rpc.address='hadoop02' -Djobmanager.memory.jvm-overhead.min='429496736b' -Dtaskmanager.resource-id='container_1660094185335_0105_01_000002' -Dweb.port='0' -Djobmanager.memory.off-heap.size='134217728b' -Dweb.tmpdir='/tmp/flink-web-1ff87434-812b-4e84-9885-99935c10025e' -Dinternal.taskmanager.resource-id.metadata='hadoop03:35769' -Djobmanager.rpc.port='46635' -Drest.address='hadoop02' -Djobmanager.memory.jvm-metaspace.size='268435456b' -Djobmanager.memory.heap.size='3462817376b' -Djobmanager.memory.jvm-overhead.max='429496736b' 1> <LOG_DIR>/taskmanager.out 2> <LOG_DIR>/taskmanager.err 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - Adding security tokens to TaskExecutor's container launch context. 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Searching Hadoop configuration files in Flink config: /opt/hadoop/hadoop-2.7.4/etc/hadoop 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/core-site.xml to hadoop configuration 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/hdfs-site.xml to hadoop configuration 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Searching Hadoop configuration files in HADOOP_CONF_DIR: /opt/hadoop/hadoop-2.7.4/etc/hadoop 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/core-site.xml to hadoop configuration 09:37:32.581 [cluster-io-thread-4] DEBUG org.apache.flink.runtime.util.HadoopUtils - Adding /opt/hadoop/hadoop-2.7.4/etc/hadoop/hdfs-site.xml to hadoop configuration 09:37:32.588 [flink-akka.actor.default-dispatcher-17] INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Requested worker container_1660094185335_0105_01_000002(hadoop03:35769) with resource spec WorkerResourceSpec {cpuCores=20.0, taskHeapSize=3.225gb (3462817321 bytes), taskOffHeapSize=0 bytes, networkMemSize=711.680mb (746250577 bytes), managedMemSize=2.780gb (2985002310 bytes)}. 09:37:32.592 [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction as:appattempt_1660094185335_0105_000001 (auth:SIMPLE) from:org.apache.hadoop.yarn.client.ServerProxy.createRetriableProxy(ServerProxy.java:94) 09:37:32.614 [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction as:appattempt_1660094185335_0105_000001 (auth:SIMPLE) from:org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:793) 09:37:32.626 [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] DEBUG org.apache.flink.yarn.YarnResourceManagerDriver - Succeeded to call YARN Node Manager to start container container_1660094185335_0105_01_000002. 09:37:37.052 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Trigger heartbeat request. 09:37:37.052 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Trigger heartbeat request. 09:37:37.052 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Received heartbeat request from 4037de5f7ed0a952ff460a961950ac71. 09:37:37.052 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Received heartbeat from 11752dc8c4ddfa25593f040e1bdc1a9e. 09:37:37.592 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Trigger heartbeat request. 09:37:38.045 [flink-akka.actor.default-dispatcher-3] DEBUG akka.serialization.Serialization(akka://flink) - Using serializer [akka.serialization.JavaSerializer] for message [org.apache.flink.runtime.rpc.messages.HandshakeSuccessMessage] 09:37:38.136 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService - Try to connect to remote RPC endpoint with address akka.tcp://flink@hadoop03:36517/user/rpc/taskmanager_0. Returning a org.apache.flink.runtime.taskexecutor.TaskExecutorGateway gateway. 09:37:38.149 [flink-akka.actor.default-dispatcher-3] DEBUG akka.serialization.Serialization(akka://flink) - Using serializer [akka.serialization.JavaSerializer] for message [org.apache.flink.runtime.rpc.messages.RemoteHandshakeMessage] 09:37:38.156 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Registering TaskManager with ResourceID container_1660094185335_0105_01_000002(hadoop03:35769) (akka.tcp://flink@hadoop03:36517/user/rpc/taskmanager_0) at ResourceManager 09:37:38.158 [flink-akka.actor.default-dispatcher-3] DEBUG akka.serialization.Serialization(akka://flink) - Using serializer [akka.serialization

Aug 12 '22 01:08 biandou1313

akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=19, endLocation='null', startLocation='null', startLocationOfSplit='117283967118544', endLocationOfSplit='null'} to hadoop03 09:37:39.667 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=19, endLocation='null', startLocation='null', startLocationOfSplit='117283967118544', endLocationOfSplit='null'}. 09:37:39.669 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=18, endLocation='null', startLocation='null', startLocationOfSplit='111111126743884', endLocationOfSplit='117283967118544'} to hadoop03 09:37:39.669 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=18, endLocation='null', startLocation='null', startLocationOfSplit='111111126743884', endLocationOfSplit='117283967118544'}. 09:37:39.669 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=17, endLocation='null', startLocation='null', startLocationOfSplit='104938286369224', endLocationOfSplit='111111126743884'} to hadoop03 09:37:39.670 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=17, endLocation='null', startLocation='null', startLocationOfSplit='104938286369224', endLocationOfSplit='111111126743884'}. 09:37:39.670 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=16, endLocation='null', startLocation='null', startLocationOfSplit='98765445994564', endLocationOfSplit='104938286369224'} to hadoop03 09:37:39.670 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=16, endLocation='null', startLocation='null', startLocationOfSplit='98765445994564', endLocationOfSplit='104938286369224'}. 09:37:39.927 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=15, endLocation='null', startLocation='null', startLocationOfSplit='92592605619904', endLocationOfSplit='98765445994564'} to hadoop03 09:37:39.927 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=15, endLocation='null', startLocation='null', startLocationOfSplit='92592605619904', endLocationOfSplit='98765445994564'}. 09:37:40.021 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=14, endLocation='null', startLocation='null', startLocationOfSplit='86419765245244', endLocationOfSplit='92592605619904'} to hadoop03 09:37:40.021 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=14, endLocation='null', startLocation='null', startLocationOfSplit='86419765245244', endLocationOfSplit='92592605619904'}. 09:37:40.128 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=13, endLocation='null', startLocation='null', startLocationOfSplit='80246924870584', endLocationOfSplit='86419765245244'} to hadoop03 09:37:40.128 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=13, endLocation='null', startLocation='null', startLocationOfSplit='80246924870584', endLocationOfSplit='86419765245244'}. 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=12, endLocation='null', startLocation='null', startLocationOfSplit='74074084495924', endLocationOfSplit='80246924870584'} to hadoop03 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=12, endLocation='null', startLocation='null', startLocationOfSplit='74074084495924', endLocationOfSplit='80246924870584'}. 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=11, endLocation='null', startLocation='null', startLocationOfSplit='67901244121264', endLocationOfSplit='74074084495924'} to hadoop03 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=11, endLocation='null', startLocation='null', startLocationOfSplit='67901244121264', endLocationOfSplit='74074084495924'}. 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=10, endLocation='null', startLocation='null', startLocationOfSplit='61728403746604', endLocationOfSplit='67901244121264'} to hadoop03 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=10, endLocation='null', startLocation='null', startLocationOfSplit='61728403746604', endLocationOfSplit='67901244121264'}. 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=9, endLocation='null', startLocation='null', startLocationOfSplit='55555563371944', endLocationOfSplit='61728403746604'} to hadoop03 09:37:40.129 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=9, endLocation='null', startLocation='null', startLocationOfSplit='55555563371944', endLocationOfSplit='61728403746604'}. 09:37:40.130 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=8, endLocation='null', startLocation='null', startLocationOfSplit='49382722997284', endLocationOfSplit='55555563371944'} to hadoop03 09:37:40.130 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=8, endLocation='null', startLocation='null', startLocationOfSplit='49382722997284', endLocationOfSplit='55555563371944'}. 09:37:40.142 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=7, endLocation='null', startLocation='null', startLocationOfSplit='43209882622624', endLocationOfSplit='49382722997284'} to hadoop03 09:37:40.142 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=7, endLocation='null', startLocation='null', startLocationOfSplit='43209882622624', endLocationOfSplit='49382722997284'}. 09:37:40.144 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=6, endLocation='null', startLocation='null', startLocationOfSplit='37037042247964', endLocationOfSplit='43209882622624'} to hadoop03 09:37:40.144 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=6, endLocation='null', startLocation='null', startLocationOfSplit='37037042247964', endLocationOfSplit='43209882622624'}. 09:37:40.146 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=5, endLocation='null', startLocation='null', startLocationOfSplit='30864201873304', endLocationOfSplit='37037042247964'} to hadoop03 09:37:40.146 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=5, endLocation='null', startLocation='null', startLocationOfSplit='30864201873304', endLocationOfSplit='37037042247964'}. 09:37:40.149 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=4, endLocation='null', startLocation='null', startLocationOfSplit='24691361498644', endLocationOfSplit='30864201873304'} to hadoop03 09:37:40.149 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=4, endLocation='null', startLocation='null', startLocationOfSplit='24691361498644', endLocationOfSplit='30864201873304'}. 09:37:40.150 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=3, endLocation='null', startLocation='null', startLocationOfSplit='18518521123984', endLocationOfSplit='24691361498644'} to hadoop03 09:37:40.150 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=3, endLocation='null', startLocation='null', startLocationOfSplit='18518521123984', endLocationOfSplit='24691361498644'}. 09:37:40.153 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=2, endLocation='null', startLocation='null', startLocationOfSplit='12345680749323', endLocationOfSplit='18518521123984'} to hadoop03 09:37:40.154 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=2, endLocation='null', startLocation='null', startLocationOfSplit='12345680749323', endLocationOfSplit='18518521123984'}. 09:37:40.155 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=1, endLocation='null', startLocation='null', startLocationOfSplit='6172840374662', endLocationOfSplit='12345680749323'} to hadoop03 09:37:40.155 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=1, endLocation='null', startLocation='null', startLocationOfSplit='6172840374662', endLocationOfSplit='12345680749323'}. 09:37:40.157 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split JdbcInputSplit{mod=0, endLocation='null', startLocation='null', startLocationOfSplit='1', endLocationOfSplit='6172840374662'} to hadoop03 09:37:40.158 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Send next input split JdbcInputSplit{mod=0, endLocation='null', startLocation='null', startLocationOfSplit='1', endLocationOfSplit='6172840374662'}.

Aug 12 '22 01:08 biandou1313

k-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: mysqlsourcefactory -> Sink: hivesinkfactory of job 2e9f246cf523737a1049a7b2830c723f is not in state RUNNING but FINISHED instead. Aborting checkpoint. 09:38:26.289 [Flink-MetricRegistry-thread-1] DEBUG org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter - Invalid type for Gauge org.apache.flink.runtime.checkpoint.CheckpointStatsTracker$LatestCompletedCheckpointExternalPathGauge@15cfad5: java.lang.String, only number types and booleans are supported by this reporter. 09:38:27.152 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Trigger heartbeat request. 09:38:27.152 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Trigger heartbeat request. 09:38:27.152 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster - Received heartbeat request from 4037de5f7ed0a952ff460a961950ac71. 09:38:27.152 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Received heartbeat from 11752dc8c4ddfa25593f040e1bdc1a9e. 09:38:27.156 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Received heartbeat from container_1660094185335_0105_01_000002. 09:38:27.156 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Received slot report from instance 9632bb7fb8bdc3e55695dd79270e067d: SlotReport{SlotStatus{slotID=container_1660094185335_0105_01_000002_0, allocationID=b2157c584c82977c323e295eadcaef8d, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_1, allocationID=00f73370646e68de37b37bb0ae3f12a1, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_2, allocationID=377f7b81f7e21e044851001bd04aeab4, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_3, allocationID=5d9b0d313b4c61ea963c45e4aac1e1af, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_4, allocationID=41adc0a9bde4362e87aa51b9de9d5557, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_5, allocationID=e9c0f1406c5051185a4a3d72c8ce4ef6, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_6, allocationID=37fc0636de57d7daad8d9ef8f080913b, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_7, allocationID=a1dc34deb46df918ad9bea859ae6205e, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_8, allocationID=b35dcfe386fe2ba94bdd440e4570a887, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_9, allocationID=c79ab7e3fb77159f6fdc73fc25d06670, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_10, allocationID=3c86c141c66e5f84cb06f3217a667648, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_11, allocationID=d8ac23390717f7e7a6cd41e8d852acda, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_12, allocationID=dd57443292ef8b16be14fece8c235eee, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_13, allocationID=a6c2775a911b332ccc11701201afbaef, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_14, allocationID=ebc77f7087faa44dbaae74a8550b98cd, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_15, allocationID=e0a5eadb9cc659303d051073240de424, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_16, allocationID=41ca9d04e15683dd961007b253d1049d, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_17, allocationID=bd7618e1cf61c6b7744a3db94226e894, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_18, allocationID=7074aad14a590fc52f2c22df9733c60b, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}SlotStatus{slotID=container_1660094185335_0105_01_000002_19, allocationID=4ae460d066fff9bd3f47cae42e7095fb, jobID=2e9f246cf523737a1049a7b2830c723f, resourceProfile=ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=165.120mb (173140866 bytes), taskOffHeapMemory=0 bytes, managedMemory=142.336mb (149250115 bytes), networkMemory=35.584mb (37312528 bytes)}}}. 09:38:27.157 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.io.network.partition.ResourceManagerPartitionTrackerImpl - Processing cluster partition report from task executor container_1660094185335_0105_01_000002: PartitionReport{entries=[]}. 09:38:27.552 [flink-akka.actor.default-dispatcher-15] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Slot Pool Status: status: connected to akka.tcp://flink@hadoop02:46635/user/rpc/resourcemanager_0 registered TaskManagers: [container_1660094185335_0105_01_000002] available slots: [AllocatedSlot bd7618e1cf61c6b7744a3db94226e894 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 17 @ 2736285024, AllocatedSlot ebc77f7087faa44dbaae74a8550b98cd @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 14 @ 2736285328, AllocatedSlot 3c86c141c66e5f84cb06f3217a667648 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 10 @ 2736284712, AllocatedSlot d8ac23390717f7e7a6cd41e8d852acda @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 11 @ 2736284809, AllocatedSlot e9c0f1406c5051185a4a3d72c8ce4ef6 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 5 @ 2736293972, AllocatedSlot 37fc0636de57d7daad8d9ef8f080913b @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 6 @ 2736284489, AllocatedSlot 00f73370646e68de37b37bb0ae3f12a1 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 1 @ 2736284075, AllocatedSlot 41ca9d04e15683dd961007b253d1049d @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 16 @ 2736284913, AllocatedSlot dd57443292ef8b16be14fece8c235eee @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 12 @ 2736293980, AllocatedSlot a6c2775a911b332ccc11701201afbaef @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 13 @ 2736284395, AllocatedSlot 377f7b81f7e21e044851001bd04aeab4 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 2 @ 2736293981, AllocatedSlot b35dcfe386fe2ba94bdd440e4570a887 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 8 @ 2736284601, AllocatedSlot a1dc34deb46df918ad9bea859ae6205e @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 7 @ 2736293983, AllocatedSlot 7074aad14a590fc52f2c22df9733c60b @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 18 @ 2736293978, AllocatedSlot e0a5eadb9cc659303d051073240de424 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 15 @ 2736284288, AllocatedSlot 41adc0a9bde4362e87aa51b9de9d5557 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 4 @ 2736285227, AllocatedSlot 5d9b0d313b4c61ea963c45e4aac1e1af @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 3 @ 2736284160, AllocatedSlot 4ae460d066fff9bd3f47cae42e7095fb @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 19 @ 2736285128] allocated slots: [[AllocatedSlot b2157c584c82977c323e295eadcaef8d @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 0, AllocatedSlot c79ab7e3fb77159f6fdc73fc25d06670 @ container_1660094185335_0105_01_000002 @ hadoop03 (dataPort=39667) - 9]] pending requests: [] }

Aug 12 '22 01:08 biandou1313

Aug 12 '22 02:08 biandou1313

同步 hive 直接写 hdfs 呢？现在的情况是任务不结束吗？

Aug 15 '22 02:08 zhiqiang-dev