dinky icon indicating copy to clipboard operation
dinky copied to clipboard

[Bug] [openapi/executeSql] 直接使用/openapi/executeSql提交的任务运维中心无法管理

Open qzgt opened this issue 2 years ago • 7 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

直接使用 : /openapi/executeSql提交的任务运维中心无法管理,状态一直显示初始化状态(INITIALIZING),同时在任务刷新的时候,报空指针异常。

What you expected to happen

任务能正常提交,监控中心能像使用Dinky ui登录后提交的一样可以监控。

How to reproduce

直接使用:http://192.168.119.1:8888/openapi/executeSql 方式:post 数据:json格式: { "type": "standalone", "address": "192.168.119.101:8081", "statement": "EXECUTE CDCSOURCE test1 WITH ( \n \n'connector' = 'mysql-cdc',\n \n'hostname' = '192.168.119.101',\n \n'port' = '3307','username' = 'root',\n \n'password' = 'root',\n \n'server-id' = '16815',\n \n'scan.incremental.snapshot.enabled' = 'false',\n \n'checkpoint' = '3000',\n \n'scan.startup.mode' = 'latest-offset',\n \n'parallelism' = '1',\n \n'database-name' = 'demo_db',\n \n'sink.connector' = 'upsert-kafka-plus',\n \n'sink.topic' = 'dlinkcdc',\n \n'sink.key.format' = 'json',\n \n'sink.value.format' = 'json',\n \n'sink.key.json.ignore-parse-errors' = 'true',\n \n'sink.value.json.fail-on-missing-field' = 'false',\n \n'sink.properties.bootstrap.servers' = '192.168.119.101:9092',\n \n'sink.properties.zookeeper.connect' = '192.168.119.101:2181'\n \n)", "useResult": false, "useStatementSet": false, "useChangeLog": false, "useAutoCancel": false, "fragment": false, "maxRowNum": 100, "checkPoint": 0, "parallelism": 1, "jobName": "openapitest" } 即可复现。 dinky:version 0.6.5

Anything else

No response

Version

0.6.5

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

qzgt avatar Jul 07 '22 06:07 qzgt

请检查 standalone 集群上的任务是否提交成功或正常运行

aiwenmo avatar Jul 07 '22 15:07 aiwenmo

请检查 standalone 集群上的任务是否提交成功或正常运行 可以正常提交,你们可以直接使用upsert-kafka模式,upsert-kafka-plus模式我们自己扩展的。所以你们要用upsert-kafka模式。

qzgt avatar Jul 11 '22 01:07 qzgt

是指通过dinky提交后,远程集群上任务是否存在

aiwenmo avatar Jul 15 '22 05:07 aiwenmo

我也遇到了这个问题,已经成功提交到远程集群上,但是,dlink后台报空指针异常,调取获取作业任务的接口返回 { "datas": { "success": false, "startTime": null, "endTime": "2022-08-11T12:34:40.286", "time": 0, "error": null, "rowData": null, "total": null, "currentCount": null, "columns": null, "destroyed": true, "jobId": "df25127acbf22017cf540c5f1cc04e66" }, "code": 0, "msg": "获取成功" }

运维中心,看到此作业显示INITIALIZING

deepthinkin avatar Aug 11 '22 04:08 deepthinkin

同样的BUG我在 0.6.6 上面也重现出来,POST 提交后返回成功信息,但在运维中心查看状态是 INITIALIZING ,跟踪了一下数据库dlink_job_instance.task_id 这些都空值,希望在 0.6.7 版本中可以修复这个BUG

{'datas': {'jobManagerAddress': '192.168.0.100:8081', 'status': 'SUCCESS', 'success': True, 'jobId': 'd7eeeda7c88667d10c10552a5c7cf98e', 'error': None, 'startTime': '2022-08-21T12:06:55.163', 'endTime': '2022-08-21T12:06:58.48'}, 'code': 0, 'msg': #'执行成功'}

ekinguofeng avatar Aug 21 '22 04:08 ekinguofeng

是0.6.7版本。

使用yarn-session模式,dinky显示initializing,但是跳转到flink ui界面可以发现,其实任务是启动了的。 image

这是flink ui界面。 image

并且无法取消任务。右上角的普通取消(不保存savepoint)。

feature09 avatar Dec 05 '22 08:12 feature09

是0.6.7版本。

使用yarn-session模式,dinky显示initializing,但是跳转到flink ui界面可以发现,其实任务是启动了的。 image

这是flink ui界面。 image

并且无法取消任务。右上角的普通取消(不保存savepoint)。

看看日志有无报错,你的问题应该是和本issue没有关系

aiwenmo avatar Dec 06 '22 12:12 aiwenmo

Hello, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] avatar Feb 01 '24 00:02 github-actions[bot]