snc icon indicating copy to clipboard operation
snc copied to clipboard

Run OpenShift conformance tests

Open cfergeau opened this issue 3 years ago • 36 comments

Rather than kubernetes/conformance, this attempts to run openshift/conformance. This disables all the instrumentation, network, node, scheduling and storage tests as I did not have time to look in details at the several dozens of failures they had. The goal is to eventually empty the ignore list and fix/ignore the ignored tests.

This is just a test PR to trigger the run of the conformance test in the CI and see how it goes.

cfergeau avatar Apr 23 '21 11:04 cfergeau

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cfergeau

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci-robot avatar Apr 23 '21 11:04 openshift-ci-robot

/hold

cfergeau avatar Apr 23 '21 11:04 cfergeau

/retest

praveenkumar avatar Apr 26 '21 02:04 praveenkumar

INFO[2021-04-26T06:39:24Z] error: 53 fail, 532 pass, 41 skip (1h59m21s) 
INFO[2021-04-26T06:39:24Z] {"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"prow/entrypoint/run.go:80","func":"k8s.io/test-infra/prow/entrypoint.Options.Run","level":"error","msg":"Error executing test process","severity":"error","time":"2021-04-26T06:39:14Z"} 
INFO[2021-04-26T06:39:24Z] error: failed to execute wrapped command: exit status 1 

@cfergeau looks like lot of tests are failing on CI and also it is taking around 2 hour :(

praveenkumar avatar Apr 26 '21 07:04 praveenkumar

/retest

praveenkumar avatar Apr 28 '21 06:04 praveenkumar

/test e2e-snc

praveenkumar avatar Apr 29 '21 05:04 praveenkumar

/test e2e-snc

cfergeau avatar Apr 29 '21 13:04 cfergeau

/test e2e-snc

cfergeau avatar Apr 30 '21 10:04 cfergeau

/retest

cfergeau avatar Apr 30 '21 13:04 cfergeau

/retest

cfergeau avatar Jun 01 '21 12:06 cfergeau

/retest

cfergeau avatar Jun 02 '21 16:06 cfergeau

/retest

praveenkumar avatar Jun 03 '21 03:06 praveenkumar

/retest

cfergeau avatar Jun 03 '21 07:06 cfergeau

/test e2e-snc

praveenkumar avatar Jun 03 '21 07:06 praveenkumar

/retest

praveenkumar avatar Jun 03 '21 09:06 praveenkumar

/retest

cfergeau avatar Jun 03 '21 15:06 cfergeau

/retest

praveenkumar avatar Jun 04 '21 07:06 praveenkumar

/retest

praveenkumar avatar Jun 04 '21 10:06 praveenkumar

/test e2e-snc

praveenkumar avatar Jun 04 '21 14:06 praveenkumar

/test e2e-snc

praveenkumar avatar Jun 07 '21 04:06 praveenkumar

/retest

praveenkumar avatar Jun 07 '21 06:06 praveenkumar

@cfergeau please squash the commits and re push (mostly the fixup one), so we can merge it.

praveenkumar avatar Jun 08 '21 03:06 praveenkumar

@cfergeau please squash the commits and re push (mostly the fixup one), so we can merge it.

Before the merge, we also need to decide when to run it, as it's quite expensive (time-wise) to run for every PR.

cfergeau avatar Jun 08 '21 13:06 cfergeau

/retest

praveenkumar avatar Jun 10 '21 05:06 praveenkumar

/retest

praveenkumar avatar Jun 14 '21 09:06 praveenkumar

/retest

praveenkumar avatar Jun 18 '21 09:06 praveenkumar

/retest

cfergeau avatar Jun 30 '21 07:06 cfergeau

/retest

cfergeau avatar Jun 30 '21 16:06 cfergeau

/retest

cfergeau avatar Jul 01 '21 12:07 cfergeau

/retest

cfergeau avatar Jul 05 '21 15:07 cfergeau