boto3 icon indicating copy to clipboard operation
boto3 copied to clipboard

EMR run_job_flow don't support r5b and r3 instance types

Open chethanuk opened this issue 1 year ago • 2 comments

Describe the bug

Even though both r3 and r5b are listed in Official doc of Supported instance types when tried to create RunJobFlow error is thrown saying 'r5b.xlarge' is not supported.

Error:

An error occurred (ValidationException) when calling the RunJobFlow operation: Instance type 'r5b.xlarge' is not supported.

An error occurred (ValidationException) when calling the RunJobFlow operation: EBS optimization is not supported for instance type r3.8xlarge.

Expected Behavior

EMR cluster should have been created with r5b.xlarge instance

Current Behavior

ValidationException) when calling the RunJobFlow operation: Instance type 'r5b.xlarge' is not supported

Reproduction Steps

Use python sdk and try create RunJobFlow using run_job_flow(**run_job_flow_kwargs) with instance fleets

Possible Solution

No response

Additional Information/Context

Environment:

pip list | grep "boto"                                                                                         ✔  9m 24s  3.7.13   02:05:08 PM 
aioboto3                             8.0.3
aiobotocore                          2.3.4
boto3                                1.24.72
boto3-stubs                          1.12.32.0
botocore                             1.27.72
mypy-boto3                           1.12.32.0
mypy-boto3-cloudformation            1.12.32.0
mypy-boto3-dynamodb                  1.12.32.0
mypy-boto3-ec2                       1.12.32.0
mypy-boto3-lambda                    1.12.32.0
mypy-boto3-rds                       1.12.32.0
mypy-boto3-s3                        1.12.32.0
mypy-boto3-sqs                       1.12.32.0
mypy-boto3-ssm                       1.12.32.0

SDK version used

1.24.72

Environment details (OS name and version, etc.)

Mac OS 12.5.1

chethanuk avatar Sep 14 '22 13:09 chethanuk

Hi @chethanuk-plutoflume thanks for reaching out. In that documentation you linked to it notes:

Not all instance types are available in all Regions, and instance availability is subject to availability and demand in the specified Region and Availability Zone.

Which region are you using? And have you tried testing this in other regions?

It looks like R5b instances were announced December 1, 2020 per https://aws.amazon.com/blogs/aws/new-amazon-ec2-r5b-instances-providing-3x-higher-ebs-performance/. At the bottom of that blog post it says:

R5b instances are available in the following regions: US West (Oregon), Asia Pacific (Tokyo), US East (N. Virginia), US East (Ohio), Asia Pacific (Singapore), and Europe (Frankfurt). RDS on r5b is available in US East (Ohio), Asia Pacific (Singapore), and Europe (Frankfurt), and support in other regions is coming soon.

tim-finnigan avatar Sep 14 '22 16:09 tim-finnigan

R5b instances

Okay so R5b is not avilable in eu-west-1, it's as expected then

you tried testing this in other regions

No haven't tried yet

chethanuk avatar Sep 15 '22 09:09 chethanuk

Since the behavior is expected per the documentation I'm going to close this issue. Please let us know if there's anything further you'd like to discuss regarding this. Thanks!

tim-finnigan avatar Nov 17 '22 23:11 tim-finnigan