Samples icon indicating copy to clipboard operation
Samples copied to clipboard

Isolate integration test runs by branch

Open bart-vmware opened this issue 2 years ago • 3 comments

Integration tests for Steeltoe samples run on PRs and on the main/latest branch. Although we recently randomized the routes, they all run in the same CloudFoundry space with fixed names, which means they influence each other.

One solution is to run them in different CF spaces, for example in /Home/steeltoe-samples/branch-name instead of the current /Home/steeltoe-samples.

bart-vmware avatar Jan 17 '23 16:01 bart-vmware

I don't think running in parallel is practical for how we're currently running tests since the path filters aren't working and we don't even have capacity to simultaneously run one round of tests

TimHess avatar Feb 10 '25 14:02 TimHess

This is about isolation, not parallelism. Samples tend to create a database. If the schema differs per branch, it won't succeed because the existing schema is incompatible. Using different spaces solves that.

Path filters are supposed to address parallelism, that's unrelated to this issue.

bart-vmware avatar Feb 10 '25 14:02 bart-vmware

This is about isolation, not parallelism. Samples tend to create a database. If the schema differs per branch, it won't succeed because the existing schema is incompatible. Using different spaces solves that.

Path filters are supposed to address parallelism, that's unrelated to this issue.

Unrelated until we run out of capacity anyway...

I tried a strategy for this in https://github.com/SteeltoeOSS/Samples/pull/361, but due to PR shuffling we'll want to re-apply the effort, ensuring to delete spaces after the run (as described in a comment on that PR)

TimHess avatar Feb 26 '25 18:02 TimHess