Taier icon indicating copy to clipboard operation
Taier copied to clipboard

Flink-1.12-standalone模式下执行Flink任务执行失败,从hdfs下载文件到本地不成功(HdfsFileManage.java)

Open cs3163077 opened this issue 1 year ago • 0 comments

Search before asking

  • [ ] I had searched in the issues and found no similar question.

  • [ ] I had searched my question on the internet but i didn't get any help.

  • [ ] I had read the documentation: Taier doc but it didn't help me.

Description

====================基本日志==================== [17:26:40] 2023-04-07 17:26:37:com.dtstack.taier.pluginapi.exception.PluginDefineException: 4l99983ituv0 failed com.dtstack.taier.pluginapi.exception.PluginDefineException: 4l99983ituv0 failed at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:225) at com.dtstack.taier.pluginapi.client.AbstractClient.submitJob(AbstractClient.java:58) at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:103) at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:99) at com.dtstack.taier.pluginapi.callback.ClassLoaderCallBackMethod.callbackAndReset(ClassLoaderCallBackMethod.java:31) at com.dtstack.taier.common.client.ClientProxy.lambda$submitJob$1(ClientProxy.java:99) at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.RuntimeException: File does not exist: /taier/tmp/4l99983ituv0_7265/jar/1_flink_cdc_sqlserver-1.0-SNAPSHOT.jar at com.dtstack.taier.base.filesystem.FilesystemManager.getLocalJarFile(FilesystemManager.java:163) at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:121) at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:82) at com.dtstack.taier.flink.util.FlinkUtil.downloadJar(FlinkUtil.java:199) at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:221) ... 9 more

Code of Conduct

  • [X] I agree to follow this project's Code of Conduct 从hdfs下载文件到本地不成功(HdfsFileManage.java) com.dtstack.taier.pluginapi.exception.PluginDefineException: 4lah1ek0qne0 failed at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:231) at com.dtstack.taier.pluginapi.client.AbstractClient.submitJob(AbstractClient.java:58) at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:103) at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:99) at com.dtstack.taier.pluginapi.callback.ClassLoaderCallBackMethod.callbackAndReset(ClassLoaderCallBackMethod.java:31) at com.dtstack.taier.common.client.ClientProxy.lambda$submitJob$1(ClientProxy.java:99) at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.RuntimeException: Wrong FS: hdfs://******/taier/1.jar, expected: file:/// at com.dtstack.taier.base.filesystem.manager.HdfsFileManage.downloadFile(HdfsFileManage.java:83) at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:114) at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:82) at com.dtstack.taier.flink.util.FlinkUtil.downloadJar(FlinkUtil.java:199) at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:227) ... 9 more

cs3163077 avatar Apr 07 '23 09:04 cs3163077