incubator-streampark icon indicating copy to clipboard operation
incubator-streampark copied to clipboard

[Bug] 作业运行状态显示-沉默,事实作业已经停掉了,在列表没法操作运行或停止

Open Jetol opened this issue 1 year ago • 1 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Java Version

1.8

Scala Version

2.12.x

StreamPark Version

2.1.4

Flink Version

1.16.3

deploy mode

kubernetes-session

What happened

1)新建flink sql,使用k8s-session运行模式,同步作业,flink SQL如下: `-- register a PostgreSQL table 'shipments' in Flink SQL CREATE TABLE t_user ( id INT, name STRING, age INT ) WITH ( 'connector' = 'postgres-cdc', 'hostname' = '192.168.231.151', 'port' = '30028', 'username' = 'test1', 'password' = 'test123', 'database-name' = 'xly_test_db', 'schema-name' = 'public', 'table-name' = 't_user', 'slot.name' = 'flink', -- experimental feature: incremental snapshot (default off) 'scan.incremental.snapshot.enabled' = 'true' );

SET execution.checkpointing.interval = 10s; -- sink doris CREATE TABLE xie_t_user ( id INT, name STRING, age INT ) WITH ( 'connector' = 'doris', -- 'sink.label-prefix' = 'mysql-sink-doris_label_2', 'fenodes' = '192.168.231.151:8030', 'table.identifier' = 'hq_demo.xie_t_user', 'username' = 'admin', 'password' = '' );

insert into xie_t_user select id, name, age from t_user;`

2)发布成功后,点击启动作业-其他正在运行的作业状态自动变为-沉默,见图2-1; 3)k8s服务器上查询pod已经没有了; 4)接着在streampark作业列表没法操作-停止或运行了。

图2-1 image

Error Exception

作业运行一段时间后失败,状态显示-沉默;

Screenshots

作业内容详细: image image image

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

Jetol avatar Aug 13 '24 09:08 Jetol

maybe because of JM restart, and then, streampark lost tracker of task, but task still run.

liudianwei avatar Jan 13 '25 03:01 liudianwei