aws-cdk icon indicating copy to clipboard operation
aws-cdk copied to clipboard

aws-eks: Support AL2_ARM_64_GPU NodeGroupAmiType

Open josephjnatale opened this issue 2 years ago • 3 comments

Describe the feature

Using the aws-eks library it would be great if I was able to create a nodeGroup with a Graviton GPU instance like the g5g class. However, the NodegroupAmiType does not support AL2_ARM_64_GPU only AL2_ARM_64 which gets denied when trying to synth cdk. If I don't specify the amiType it defaults to AL2_x86_64_GPU and errors out that the g5g.xlarge is not a valid instance type for the requested amiType.

Use Case

To create a nodeGroup with a g5g instance type

Proposed Solution

add support for AL2_ARM_64_GPU to the NodegroupAmiType enum.

Other Information

No response

Acknowledgements

  • [ ] I may be able to implement this feature request
  • [ ] This feature might incur a breaking change

CDK version used

2.87.0

Environment details (OS name and version, etc.)

Mac os 12.4

josephjnatale avatar Jul 13 '23 17:07 josephjnatale

According to the doc

All Amazon EKS AMIs don't currently support the g5g and mac families.

I guess it's not supported yet. But I am interested to know your use case. Why you'd like to use g5g to run Amazon EKS nodegroup? What kind of the workload are you running in k8s?

pahud avatar Jul 13 '23 23:07 pahud

I am running an image Inferencing model in EKS and I'm looking to have the most cost effective instance type with a GPU. The g5g is about 20% cheaper than the g4dn which I'm currently using. I tried using the inferentia instance class but unfortunately only inf1 is available in us-west-2 currently, and I was not able to get the same performance per dollar with our workload.

josephjnatale avatar Jul 14 '23 14:07 josephjnatale

Probably this is blocked by https://github.com/awslabs/amazon-eks-ami/issues/853 ?

See also https://docs.aws.amazon.com/eks/latest/APIReference/API_Nodegroup.html

chulkilee avatar Aug 19 '24 06:08 chulkilee