apprunner-roadmap icon indicating copy to clipboard operation
apprunner-roadmap copied to clipboard

initialDelaySeconds for healthy probe

Open ShwareAPI opened this issue 1 year ago • 7 comments

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request If you are interested in working on this issue or have submitted a pull request, please leave a comment

Tell us about your request Support initialDelaySeconds config for healthy probe

Describe alternatives you've considered Because some applications take a long time to start, it is impossible to determine whether they are healthy through repeated requests.

ShwareAPI avatar Oct 31 '23 11:10 ShwareAPI

Hi @ShwareAPI, Thanks for reaching out. If you don't mind can you share how long the test application that you are running here takes for the startup? We are working on few improvements in this area and your input will help us make the experience more delightful.

hariohmprasath avatar Oct 31 '23 16:10 hariohmprasath

@hariohmprasath

The spring boot application takes 30-60 seconds to start, and health checks during this time are useless.

ShwareAPI avatar Nov 07 '23 08:11 ShwareAPI

Hi @ShwareAPI, We are adding some tolerance to our health check systems so if your application takes beyond 1 minute to fully startup we dont fail the service creation in this case. Please watch out for upcoming announcements in the next few weeks.

hariohmprasath avatar Nov 07 '23 17:11 hariohmprasath

@hariohmprasath Python import machine learning library takes 120 seconds in cpu throttled. If CPU is not hrottled, it will about 10 secons.

I'm expecting upcoming announcements

chai3 avatar Nov 17 '23 14:11 chai3

@hariohmprasath Python import machine learning library takes 120 seconds in cpu throttled. If CPU is not hrottled, it will about 10 secons.

I'm expecting upcoming announcements

Hi @chai3,

Thank you for contacting us. To give you some context, currently, App Runner does not throttle the CPU for one minute after launching the tasks. Therefore, if your application takes only 10 seconds to startup, it should work as expected. However, to better understand the behavior, we would appreciate if you could add additional logging as part of the startup routine and share your service ARN with us.

Please let us know if you have any other queries. Thanks

hariohmprasath avatar Nov 18 '23 05:11 hariohmprasath

App Runner does not throttle the CPU for one minute after launching the tasks

@hariohmprasath Thanks for your reply. I did not notice. That's very good news. I will re-measure and report if there are any problems. If it's not throttled for one minute after launching the tasks, I can remove precompile to pyc and lazy python imports.

chai3 avatar Nov 18 '23 06:11 chai3

@hariohmprasath cc @hariohmprasath

https://docs.aws.amazon.com/apprunner/latest/relnotes/release-2023-12-07-slowstartup.html

AWS App Runner instance to complete its startup tasks has increased from one to five minutes

It's not configurable, but 5 minutes is plenty for my use case.

chai3 avatar Dec 11 '23 09:12 chai3