[Bug] 1.2.2 can not submit a application job to k8s

[bulolo]

Search before asking

• [x] I had searched in the issues and found no similar issues.

What happened

a avaliable k8s and make it on dinky

submit a flink sql job

Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Could not create Kubernetes cluster "datagen-1".
	at org.apache.flink.kubernetes.KubernetesClusterDescriptor.deployClusterInternal(KubernetesClusterDescriptor.java:285)
	at org.apache.flink.kubernetes.KubernetesClusterDescriptor.deployApplicationCluster(KubernetesClusterDescriptor.java:219)
	at org.dinky.gateway.kubernetes.KubernetesApplicationGateway.deployApplication(KubernetesApplicationGateway.java:188)
	at org.dinky.gateway.kubernetes.KubernetesApplicationGateway.submitJar(KubernetesApplicationGateway.java:105)
	... 161 more
Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.util.Map
	at org.apache.flink.configuration.YamlParserUtils.convertAndDumpYamlFromFlatMap(YamlParserUtils.java:165)
	at org.apache.flink.configuration.ConfigurationUtils.convertConfigToWritableLines(ConfigurationUtils.java:251)
	at org.apache.flink.kubernetes.kubeclient.decorators.FlinkConfMountDecorator.getClusterSideConfData(FlinkConfMountDecorator.java:157)
	at org.apache.flink.kubernetes.kubeclient.decorators.FlinkConfMountDecorator.buildAccompanyingKubernetesResources(FlinkConfMountDecorator.java:132)
	at org.apache.flink.kubernetes.kubeclient.factory.KubernetesJobManagerFactory.buildKubernetesJobManagerSpecification(KubernetesJobManagerFactory.java:94)
	at org.apache.flink.kubernetes.KubernetesClusterDescriptor.deployClusterInternal(KubernetesClusterDescriptor.java:270)
	... 164 more

Process FlinkSubmit/5 exit with status:FAILED

What you expected to happen

submit to k8s

How to reproduce

make a flink sql,submit a application

--创建源表datagen_source
CREATE TABLE datagen_source (id BIGINT, name STRING)
WITH
  ('connector' = 'datagen');

--创建结果表blackhole_sink
CREATE TABLE blackhole_sink (id BIGINT, name STRING)
WITH
  ('connector' = 'blackhole');

--将源表数据插入到结果表
INSERT INTO
  blackhole_sink
SELECT
  id,
  name
from
  datagen_source;

Anything else

No response

Version

dev

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [x] I agree to follow this project's Code of Conduct

[github-actions[bot]]

Hello @bulolo, this issue is about K8S, so I assign it to @gaoyan1998 and @zackyoungh. If you have any questions, you can comment and reply.

你好 @bulolo, 这个 issue 是关于 K8S 的，所以我把它分配给了 @gaoyan1998 和 @zackyoungh。如有任何问题，可以评论回复。

[dzt-studio]

我也遇到相同的问题，而且在自定义配置项里无法找到s3相关的配置，新增配置也无法获取

[aiwenmo]

#4285

[bulolo]

#4285

看到会合并到1.2，镜像是直接用1.2对吧？

[aiwenmo]

I've updated the installation package of Dinky 1.2.2. You can try to download it.

[bulolo]

I've updated the installation package of Dinky 1.2.2. You can try to download it.

fixed

[bulolo]

hi,please reopen it, when restore from savepoint,the same error

[bulolo]

i test it:

the flink sql can submit to application mode but the flink jar can not

• flink sql

• flink jar

[bulolo]

i find out the problem:

if i add this two params ,flink jar can not subimit to application

[bulolo]

beside, in 1.2.2-1.20,if i add below at the left side,and run , only run the left side code,the right size flink jar task did not run

set 'kubernetes.jobmanager.cpu.amount'='1.0'
set 'kubernetes.taskmanager.cpu.amount'='1.0'

[bulolo]

from https://github.com/DataLinkDC/dinky/pull/4297 it can build a new image

[github-actions[bot]]

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃，7 天后将关闭，如需回复，可以评论回复。