ec2-plugin icon indicating copy to clipboard operation
ec2-plugin copied to clipboard

reduce number of getPasswordData calls

Open obstiger opened this issue 5 years ago • 1 comments

If the AMI was not setup to generate passwords, AWS does not generate passwords. In such cases, ec2 plugin keeps making EC2 api attempting to get the password. This exhausts the allowed EC2 api calls from aws side and AWS starts throttling the api calls, especially if multiple nodes are spun up at the same time.

This PR attempts to address this issue by reducing the frequency of GetPasswordData calls using exponential back off with full jitter.

Here is an example of the log messages printed out: image

obstiger avatar May 22 '20 20:05 obstiger

This seems to come with the problem that it would increase the time it takes for the node to connect by a large amount

res0nance avatar Aug 25 '20 22:08 res0nance