initialization-actions Add an initialization action to change the node manager's log directory path to local SSDs

Add an initialization action to change the node manager's log directory path to local SSDs

Open datasherlock opened this issue 3 years ago • 4 comments

trafficstars

If there are no local SSDs, the script will not add any property to yarn-site and the default boot disk path will be used
If there are multiple mounts, it will create a comma separated list of paths for the property based on the MAX_MNT_DISK_FOR_LOGS setting.
If MAX_MNT_DISK_FOR_LOGS is greater than the actual disks, then the actual disk count will be used. If not, the configuration will be honoured.
The fluentd configuration file is modified to monitor the new path for pushing to Cloud Logging

Oct 06 '22 09:10 datasherlock

/gcbrun

Oct 13 '22 07:10 datasherlock

@jainyogesh - Can you please help me find a reviewer for this PR?

Oct 14 '22 03:10 datasherlock

@ranu010101 , @vinayakumarb, @medb - can one of you please help review it or suggest another reviewr

Oct 14 '22 09:10 jainyogesh

/gcbrun

Jan 06 '23 11:01 jayadeep-jayaraman