bottlerocket-ecs-updater icon indicating copy to clipboard operation
bottlerocket-ecs-updater copied to clipboard

Add mindful draining

Open WilboMo opened this issue 3 years ago • 2 comments

What I'd like: Currently Updater operates under the assumption that it is the only actor manipulating the instances to DRAINING or ACTIVE. In situations where this is not true instance state could be unintentionally changed negatively by Updater. Implementing a mechanism to check for state changes by other actors and handling the instances accordingly could prevent these issues and allow Updater to run in clusters where it is not the only manipulator of an instance's state.

WilboMo avatar Apr 19 '21 17:04 WilboMo

We could use CloudWatch Rule to filter and detect ECS events emitted by CloudTrail. From the various integrations available, like SQS, SNS, Lambda etc., the rule, when triggered, would set off custom logic within Updater. Thoughts?

umairishaq avatar May 10 '21 19:05 umairishaq

We could use CloudWatch Rule to filter and detect ECS events emitted by CloudTrail. From the various integrations available, like SQS, SNS, Lambda etc., the rule, when triggered, would set off custom logic within Updater. Thoughts?

I think thats a great idea and totally worth exploring. Thank you for the suggestion!

WilboMo avatar May 11 '21 18:05 WilboMo