[Optimization][jobmanager memory] dlink task, seems cost more jobmanager memory and cause jm down

[txl2017]

Search before asking

• [X] I had searched in the issues and found no similar optimization requirement.

Description

is dlink commit task is sql client commit

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[aiwenmo]

Hi.Thanks for your question.What is your SQL?

[txl2017]

Hi.Thanks for your question.What is your SQL?

insert into table1 (field1,.....,fieldN) select * from table2/+OPTIONS('read.streaming.enabled'='true','read.streaming.skip_compaction'='true')/);

a simple sql like this , stream read hudi table insert doris

[txl2017]

and this is today monitor info

[txl2017]

when stop dlink，it seems OK

[aiwenmo]

Maybe dinky gets the metrics of jobmanager too fast.