ambari-flink-service icon indicating copy to clipboard operation
ambari-flink-service copied to clipboard

taskmanager.numberOfTaskSlots doesn't work in YARN session

Open spolex opened this issue 8 years ago • 1 comments

When flink is started as ambari service (yarn session), the command will be launched without the -s parameter which was established in the log as taskmanager.numberOfTaskSlots:

Execute['export HADOOP_CONF_DIR=/etc/hadoop/conf; /opt/flink/bin/yarn-session.sh -n 10 -jm 1024 -tm 2048 -qu default -nm flinkapp-from-ambari -d -st >> /var/log/flink/flink-setup.log'] {'user': 'flink'}

It's wrong because it needs one container for each parallel task with this configuration and it can not change the number of slots.

spolex avatar Oct 18 '16 07:10 spolex

I resolved this issue. It has been incorporated in the new version.

jamesbenharris avatar Dec 29 '16 18:12 jamesbenharris