securedrop
securedrop copied to clipboard
CI Tests Are Failing Intermittently
Description
I've noticed that recent CI builds for the securedrop repo are failing for seemingly no reason. Re-running the tests (without any code changes) will allow the tests to eventually pass.
Steps to Reproduce
Trigger a new CI build
Expected Behavior
It builds with all tests succeeding
Actual Behavior
Test builds are intermittent. For example, from within Circle CI you can see where builds from the branch I created yesterday have alternated between being successful, failing on the app-tests
, and failing on admin-tests
this morning.
Yesterday I did have some code changes that broke the tests, but all the failures today were happening outside of my code changes.
I've noticed similar failures on other CI tests this morning and afternoon that don't appear to correspond to underlying code issues.
Comments
app-page-layout-tests
failure, also assert None == 200
:
https://app.circleci.com/pipelines/github/freedomofpress/securedrop/4710/workflows/139ff84c-73f7-4961-9349-863400896a42/jobs/64016