FlowKit icon indicating copy to clipboard operation
FlowKit copied to clipboard

Flaky integration test

Open Thingus opened this issue 2 years ago • 2 comments

Flaky integration tests; one or two of the integration tests are failing on first run, but running fine on re-runs. Tests are failing with Max retries exceeded with url: /api/0/spec/openapi.json.

Product Integration tests + Autoflow

Version 1.18.1+

To Reproduce Steps to reproduce the behaviour: Make a commit; you will see the test failing on first run

Expected behaviour Test should pass first try or fail consistently

Screenshots image

Additional context At present, am rerunning failed tests to get through CI - they pass green on 'rerun failed tests'

Thingus avatar Jan 31 '23 12:01 Thingus

Not an autoflow test that's failing. Seems to be the first of the query tests failing, but only (?) with the sync http client.

greenape avatar Feb 03 '23 13:02 greenape

Ahh, I see. It is flaming out in the universal access token generator which calls flowapi to get the spec.

greenape avatar Feb 03 '23 13:02 greenape