boto3
boto3 copied to clipboard
EMR run_job_flow don't support r5b and r3 instance types
Describe the bug
Even though both r3 and r5b are listed in Official doc of Supported instance types when tried to create RunJobFlow error is thrown saying 'r5b.xlarge' is not supported
.
Error:
An error occurred (ValidationException) when calling the RunJobFlow operation: Instance type 'r5b.xlarge' is not supported.
An error occurred (ValidationException) when calling the RunJobFlow operation: EBS optimization is not supported for instance type r3.8xlarge.
Expected Behavior
EMR cluster should have been created with r5b.xlarge instance
Current Behavior
ValidationException) when calling the RunJobFlow operation: Instance type 'r5b.xlarge' is not supported
Reproduction Steps
Use python sdk and try create RunJobFlow using run_job_flow(**run_job_flow_kwargs)
with instance fleets
Possible Solution
No response
Additional Information/Context
Environment:
pip list | grep "boto" ✔ 9m 24s 3.7.13 02:05:08 PM
aioboto3 8.0.3
aiobotocore 2.3.4
boto3 1.24.72
boto3-stubs 1.12.32.0
botocore 1.27.72
mypy-boto3 1.12.32.0
mypy-boto3-cloudformation 1.12.32.0
mypy-boto3-dynamodb 1.12.32.0
mypy-boto3-ec2 1.12.32.0
mypy-boto3-lambda 1.12.32.0
mypy-boto3-rds 1.12.32.0
mypy-boto3-s3 1.12.32.0
mypy-boto3-sqs 1.12.32.0
mypy-boto3-ssm 1.12.32.0
SDK version used
1.24.72
Environment details (OS name and version, etc.)
Mac OS 12.5.1
Hi @chethanuk-plutoflume thanks for reaching out. In that documentation you linked to it notes:
Not all instance types are available in all Regions, and instance availability is subject to availability and demand in the specified Region and Availability Zone.
Which region are you using? And have you tried testing this in other regions?
It looks like R5b instances were announced December 1, 2020 per https://aws.amazon.com/blogs/aws/new-amazon-ec2-r5b-instances-providing-3x-higher-ebs-performance/. At the bottom of that blog post it says:
R5b instances are available in the following regions: US West (Oregon), Asia Pacific (Tokyo), US East (N. Virginia), US East (Ohio), Asia Pacific (Singapore), and Europe (Frankfurt). RDS on r5b is available in US East (Ohio), Asia Pacific (Singapore), and Europe (Frankfurt), and support in other regions is coming soon.
R5b instances
Okay so R5b is not avilable in eu-west-1, it's as expected then
you tried testing this in other regions
No haven't tried yet
Since the behavior is expected per the documentation I'm going to close this issue. Please let us know if there's anything further you'd like to discuss regarding this. Thanks!