amazon-ec2-instance-selector icon indicating copy to clipboard operation
amazon-ec2-instance-selector copied to clipboard

Filter for selecting Trainium Instances

Open GyandeepKalita opened this issue 1 year ago • 0 comments
trafficstars

Hi,

There seems to be no filter in the ec2-instance-selector to select the AWS Trainium Instances. It would be of great help if a filter for this can be included. Maybe some filter for NeuronInfo as in the describe instance types, similar to --inference-accelerator would be fine:

$ aws ec2 describe-instance-types --instance-type="trn1.32xlarge"
      ...
      "NeuronInfo": {
               "NeuronDevices": [
                   {
                       "Count": 16,
                       "Name": "Trainium",
                       "CoreInfo": {
                           "Count": 2,
                           "Version": 2
                       },
                       "MemoryInfo": {
                           "SizeInMiB": 32768
                       }
                   }
               ],
               "TotalNeuronDeviceMemoryInMiB": 524288
           },

Thanks in advance.

GyandeepKalita avatar Oct 01 '24 11:10 GyandeepKalita