incubator-streampark icon indicating copy to clipboard operation
incubator-streampark copied to clipboard

[Bug] the config of 'memory sizes' in [Application Conf] do not effective

Open bing0109 opened this issue 1 year ago • 3 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Java Version

1.8

Scala Version

2.11.x

StreamPark Version

2.1.2

Flink Version

1.18.1

deploy mode

yarn-application

What happened

i create a flink job, and turn on the [Application Conf],set 'jobmanager.memory.process.size' and 'taskmanager.memory.process.size' like the follow img, but it donot effective after i start the job. image

when i set in the webUI ,it works normal image

in the flink Official website, it describe as follow


jobmanager.memory.process.size: Total size of the JobManager (JobMaster / ResourceManager / Dispatcher) process.
taskmanager.memory.process.size: Total size of the TaskManager process.
The total sizes include everything. Flink will subtract some memory for the JVM’s own memory requirements (metaspace and others), and divide and configure the rest automatically between its components (JVM Heap, Off-Heap, for Task Managers also network, managed memory etc.).

These values are configured as memory sizes, for example 1536m or 2g.

so, why the config in [Application Conf] does not effective?

Error Exception

No response

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

bing0109 avatar Mar 20 '24 09:03 bing0109