dashboard icon indicating copy to clipboard operation
dashboard copied to clipboard

Fix e2e tests for release branches

Open embik opened this issue 3 years ago • 1 comments

Which jobs are failing?: pre-dashboard-test-e2e across all active release branches is flaky and for release/v2.20 doesn't seem to pass at all.

Which test(s) are failing?:

1) DigitalOcean Provider
       should verify that there are no clusters:
     CypressError: Timed out retrying after 600000ms: `cy.wait()` timed out waiting `600000ms` for the 1st request to the route: `default-6`. No request ever occurred.
1) KubeVirt Provider
       should wait for the cluster to be ready:
     AssertionError: Timed out retrying after 600000ms: Expected to find element: `.cluster-name`, but never found it.

Among others. Check job history, it appears that various tests are failing: https://public-prow.loodse.com/job-history/gs/prow-dev-public-data/pr-logs/directory/pre-dashboard-test-e2e.

Since when has it been failing?:

Unclear, has been a problem for several releases.

Prow link to failing test:

https://public-prow.loodse.com/job-history/gs/prow-dev-public-data/pr-logs/directory/pre-dashboard-test-e2e

Reason for failure:

Failing test cases

Anything else we need to know?:

/

embik avatar Oct 19 '22 06:10 embik

I've marked E2E tests optional in release/v2.19 and release/v2.20 branches to smooth the release process a bit. I'm not closing this issue in case we want to further investigate and fix flaky tests.

Waseem826 avatar Nov 01 '22 11:11 Waseem826