media-insights-on-aws icon indicating copy to clipboard operation
media-insights-on-aws copied to clipboard

Refactor MIE asynchronous typed operators to use a Step Function Lambda Service integration instead of polling

Open aburkleaux-amazon opened this issue 4 years ago • 0 comments

The state machines don’t take advantage of Service Integration. It is important for numbers of reasons:

  • Cost optimization: Step Functions is charged by numbers of State Transitions and Lambda is charged by Invocations. For small number of videos, you may not see the difference. For mass migration, these numbers add up.
  • State transition limits to 25,000 in a single execution. It seems a lot but it is not. If you have a long video, it can fail very easily.
  • Improve readability of the workflow

aburkleaux-amazon avatar Jun 30 '20 16:06 aburkleaux-amazon