sceptre icon indicating copy to clipboard operation
sceptre copied to clipboard

Update integration tests to use vcrpy

Open ngfgrant opened this issue 6 years ago • 1 comments

CONTEXT

Our Integration tests are pretty slow - taking around 15 minutes to complete each full run. This is a pain for development and also during deployments.

We also have another issue as in order to allow integration tests to run from contributors external to Cloudreach we would need to allow access to our sceptre test AWS account which is used during our circleci builds.

We could utilise a library like vcr.py to store the results of CloudFormation API requests and for the majority of test to be run against these during branch development. As stated in the vcr project this would give us:

  • The ability to work offline
  • Completely deterministic tests
  • Increased test execution speed

but importantly it would also allow external contributors PRs to run the integration tests which would make life easier for the maintainers. Currently, we have to create a branch and merge the external PR into it in order to trigger the build in circleci - or of course clone it and run locally.

DONE WHEN

Firstly, we should evaluate whether we can indeed utilise VCR.py and if so then implement it by decorating the existing integration tests.

ngfgrant avatar Jun 28 '19 14:06 ngfgrant

What about https://github.com/localstack/localstack - would that help?

1oglop1 avatar Jul 05 '19 06:07 1oglop1