ucx icon indicating copy to clipboard operation
ucx copied to clipboard

Job Clusters created on AWS should use auto-az

Open dmoore247 opened this issue 2 years ago • 2 comments

I have jobs failing because they are running in AZs with limited or no availability of vm types being used. The zone_id should equal auto in the job cluster configuration ("zone_id": "auto",)

dmoore247 avatar Oct 30 '23 22:10 dmoore247

User may see

run failed with error message
 Cluster 9999-999999-z4wp51nk was terminated while waiting on it to be ready: 
Cluster 9999-999999-z4wp51nk is in unexpected state Terminated: AWS_UNSUPPORTED_FAILURE(CLOUD_FAILURE):
aws_api_error_code:Unsupported,aws_error_message: Your requested instance type (m5d.large) is not supported in your requested Availability Zone (us-east-1e). 
Please retry your request by not specifying an Availability Zone or choosing us-east-1a, us-east-1b, us-east-1c, us-east-1d, us-east-1f..

dmoore247 avatar Oct 30 '23 22:10 dmoore247

Thank you for the feature request! Currently, the team operates in a limited capacity, carefully prioritizing, and we cannot provide a timeline to implement this feature. Please make a Pull Request if you'd like to see this feature sooner, and we'll guide you through the journey.

The change required is in the installer

nfx avatar Oct 31 '23 07:10 nfx