aws-eks: Support AL2_ARM_64_GPU NodeGroupAmiType
Describe the feature
Using the aws-eks library it would be great if I was able to create a nodeGroup with a Graviton GPU instance like the g5g class. However, the NodegroupAmiType does not support AL2_ARM_64_GPU only AL2_ARM_64 which gets denied when trying to synth cdk. If I don't specify the amiType it defaults to AL2_x86_64_GPU and errors out that the g5g.xlarge is not a valid instance type for the requested amiType.
Use Case
To create a nodeGroup with a g5g instance type
Proposed Solution
add support for AL2_ARM_64_GPU to the NodegroupAmiType enum.
Other Information
No response
Acknowledgements
- [ ] I may be able to implement this feature request
- [ ] This feature might incur a breaking change
CDK version used
2.87.0
Environment details (OS name and version, etc.)
Mac os 12.4
According to the doc
All Amazon EKS AMIs don't currently support the g5g and mac families.
I guess it's not supported yet. But I am interested to know your use case. Why you'd like to use g5g to run Amazon EKS nodegroup? What kind of the workload are you running in k8s?
I am running an image Inferencing model in EKS and I'm looking to have the most cost effective instance type with a GPU. The g5g is about 20% cheaper than the g4dn which I'm currently using. I tried using the inferentia instance class but unfortunately only inf1 is available in us-west-2 currently, and I was not able to get the same performance per dollar with our workload.
Probably this is blocked by https://github.com/awslabs/amazon-eks-ami/issues/853 ?
See also https://docs.aws.amazon.com/eks/latest/APIReference/API_Nodegroup.html