dinky icon indicating copy to clipboard operation
dinky copied to clipboard

[Bug] flink-sql从检查点启动任务,代码里写没有生效,在页面配置生效了

Open Leijingwen opened this issue 2 years ago • 4 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

1.flink-sql 代码里写了检查点路径,重启任务没有生效

flink-sql设置检查点

2.从web页面设置检查点生效了

web-页面设置检查点

What you expected to happen

希望从检查点由代码设置可以生效,flink sql client 就可以通过 SET execution.savepoint.path = 'hdfs:xxxxx' 生效

How to reproduce

Anything else

No response

Version

0.6.6

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

Leijingwen avatar Aug 09 '22 09:08 Leijingwen

savepoint 被 dinky 托管了,不建议使用 set 来配置

aiwenmo avatar Aug 09 '22 14:08 aiwenmo

这个问题和 dinky在 flink on yarn模式下 在flink-conf.yaml里配置了checkpoint相关的配置没生效类似,这个能修复成都生效吗?是有实现上的难点吗?感觉生效会合理一些,不然感觉和原生的出入有点大啊

peter-cd avatar Aug 29 '22 07:08 peter-cd

这个问题和 dinky在 flink on yarn模式下 在flink-conf.yaml里配置了checkpoint相关的配置没生效类似,这个能修复成都生效吗?是有实现上的难点吗?感觉生效会合理一些,不然感觉和原生的出入有点大啊

不一样,session 集群的flink-conf.yaml的checkpoint是不生效的。而讨论的这个问题是 Dinky 的savepoint托管机制优先级比你的set高。

aiwenmo avatar Sep 03 '22 08:09 aiwenmo

我也有类似问题,参看:https://github.com/DataLinkDC/dlink/discussions/1182

koqiui avatar Oct 30 '22 16:10 koqiui

Hello, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] avatar Feb 01 '24 00:02 github-actions[bot]