incubator-streampark icon indicating copy to clipboard operation
incubator-streampark copied to clipboard

[Bug] k8s application mode enable "Use System Hadoop Conf" build fail.

Open liuxu2630 opened this issue 1 year ago • 4 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Java Version

1.8

Scala Version

2.11.x

StreamPark Version

2.1.0

Flink Version

1.14.4

deploy mode

None

What happened

i use k8s application mode to deploy flink job. sink doris, needs enable checkpoint and use hdfs, so i enable "Use System Hadoop Conf", but, build fail. 我使用k8s application模式提交flink任务,利用flinkcdc读取mysql数据并写入doris,因为使用doris要配置checkpoint,所以开启hdfs,配置页面里只看到了"Use System Hadoop Conf",点击开启后,在编译构建时出现了报错。

Error Exception

No response

Screenshots

image

image

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

liuxu2630 avatar Jun 20 '23 14:06 liuxu2630

Please provide relevant log information.

senlizishi avatar Jun 21 '23 01:06 senlizishi

image image

liuxu2630 avatar Jun 21 '23 03:06 liuxu2630

It seems to be a path problem, I am not familiar with HDFS and doris, you can check whether the relevant path is misconfigured.

senlizishi avatar Jun 21 '23 03:06 senlizishi

me too

minchowang avatar Nov 28 '23 09:11 minchowang