bigdata-examples icon indicating copy to clipboard operation
bigdata-examples copied to clipboard

Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint

Open londing opened this issue 4 years ago • 10 comments

window下远程提交出错

londing avatar Sep 06 '21 01:09 londing

我也出现了相同问题,在网上查出唯一的解决办法是修改flink-yarn的源码,以确保classpath包含运行的主类YarnApplicationClusterEntryPoint 。还有其他解决方法么?

misi1987107 avatar Sep 15 '21 08:09 misi1987107

暂未在windows上提交成功,通过修改源码可以找到YarnApplicationClusterEntryPoint的类,但出现了其他错误,暂时搁置了。应该需要设置classpath

------------------ 原始邮件 ------------------ 发件人: @.>; 发送时间: 2021年11月16日(星期二) 下午3:41 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

我也出现了相同的问题,在网上查出唯一的解决办法是修改flink-yarn的源码,以确保类路径包含运行的主类YarnApplicationClusterEntryPoint。还有其他解决方法吗?

好像大佬解决了这个问题,想请教一下

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

misi1987107 avatar Nov 16 '21 07:11 misi1987107

打包到linux服务器可以提交到yarn,只是无法windows提交到yarn

------------------ 原始邮件 ------------------ 发件人: @.>; 发送时间: 2021年11月16日(星期二) 下午3:54 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

在服务器打成jar包也不行是吗?

打成jar包服务器运行报这个错,但是在yarn上看不到提交的任务,而win上可以看到报错的任务

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

misi1987107 avatar Nov 16 '21 07:11 misi1987107

windows的我确实也没做过,抱歉,我是在linux和mac上做的,应该是可以通过修改源码来兼容一下吧,根据获取的系统类型做一下判断

zhangjun0x01 avatar Nov 17 '21 02:11 zhangjun0x01

好的,谢谢大佬

------------------ 原始邮件 ------------------ 发件人: "zhangjun0x01/bigdata-examples" @.>; 发送时间: 2021年11月17日(星期三) 上午10:10 @.>; 抄送: "you can @.@.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

windows的我确实也没做过,抱歉,我是在linux和mac上做的,应该是可以通过修改源码来兼容一下吧,根据获取的系统类型做一下判断

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

Joy-ful avatar Nov 17 '21 02:11 Joy-ful

在linux上提交到yarn,不需要修改源码,可以直接使用

------------------ 原始邮件 ------------------ 发件人: @.>; 发送时间: 2021年11月17日(星期三) 上午10:37 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

好的,谢谢大佬

------------------ 原始邮件 ------------------ 发件人: "zhangjun0x01/bigdata-examples" @.>; 发送时间: 2021年11月17日(星期三) 上午10:10 @.>; 抄送: "you can @.@.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

windows的我确实也没做过,抱歉,我是在linux和mac上做的,应该是可以通过修改源码来兼容一下吧,根据获取的系统类型做一下判断

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

misi1987107 avatar Nov 17 '21 02:11 misi1987107

给你推荐一下一个开源的flink任务提交平台,里面也是用了这种方式,你可以看下源码,同时支持yarn和k8s

http://www.streamxhub.com/

zhangjun0x01 avatar Nov 17 '21 02:11 zhangjun0x01

好的好的,再次感谢各位大佬

------------------ 原始邮件 ------------------ 发件人: "zhangjun0x01/bigdata-examples" @.>; 发送时间: 2021年11月17日(星期三) 上午10:45 @.>; 抄送: "you can @.@.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

在linux上提交到yarn,不需要修改源码,可以直接使用

------------------ 原始邮件 ------------------ 发件人: @.>;
发送时间: 2021年11月17日(星期三) 上午10:37 收件人: @.
>;
抄送: @.>; @.>;
主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

好的,谢谢大佬

------------------ 原始邮件 ------------------
发件人: "zhangjun0x01/bigdata-examples" @.>;
发送时间: 2021年11月17日(星期三) 上午10:10
@.
>;
抄送: "you can @.@.>;
主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

windows的我确实也没做过,抱歉,我是在linux和mac上做的,应该是可以通过修改源码来兼容一下吧,根据获取的系统类型做一下判断


You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

Joy-ful avatar Nov 17 '21 02:11 Joy-ful

再次感谢大佬,我学习一下

------------------ 原始邮件 ------------------ 发件人: "zhangjun0x01/bigdata-examples" @.>; 发送时间: 2021年11月17日(星期三) 上午10:47 @.>; 抄送: "you can @.@.>; 主题: Re: [zhangjun0x01/bigdata-examples] Error: Could not find or load main class org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint (#10)

给你推荐一下一个开源的flink任务提交平台,里面也是用了这种方式,你可以看下源码,同时支持yarn和k8s

http://www.streamxhub.com/

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

Joy-ful avatar Nov 17 '21 02:11 Joy-ful

请问这个问题最终是如何解决的

luckyLJY avatar Apr 24 '24 09:04 luckyLJY