booster icon indicating copy to clipboard operation
booster copied to clipboard

Find a replacement for serverless-artillery for integration load tests

Open juanjoman opened this issue 4 years ago • 2 comments

While researching how to fix load testing integration tests, it seems that the serverless-artillery repo disappeared: https://www.reddit.com/r/serverless/comments/otdmqz/serverless_artillery_github/

The repo gives a 404: https://github.com/Nordstrom/serverless-artillery

Apart from that, I found out that serverless-artillery deploys a lambda with node10.x, which is going to be soon deprecated by AWS (August 30th is the end of phase 2): https://docs.aws.amazon.com/lambda/latest/dg/runtime-support-policy.html?icmpid=docs_lambda_console.

We should try to find another solution for this, as discussed in discord.

juanjoman avatar Aug 17 '21 13:08 juanjoman

It looks like there's a pro version of artillery that is free for small projects (dev tier) and allows running artillery in AWS up to 1000 test minutes/month. It could be a drop-in replacement for our current solution based on serverless-artillery: https://www.artillery.io/pricing

javiertoledo avatar Apr 18 '22 12:04 javiertoledo

Given that our AWS tests take 30 mins, 1000 test minutes would be 33 pull requests at most.

Note that we have a fork at https://github.com/boostercloud/serverless-artillery , so if we need to update it at some time, we could do so, or even rolling out our own solution with a Booster app?

NickSeagull avatar Jun 29 '22 10:06 NickSeagull