origin
origin copied to clipboard
Published
20 hours ago •
openshift
openshift
Add communication matrix test under networking
The commatrix module automatically generates an accurate and up-to-date communication flows matrix that can be delivered to customers as part of product documentation for all ingress flows of OpenShift (multi-node and single-node deployments).
This test validates that the documented network flow Matrix covers all the ingress traffic open ports on the nodes, by comparing it to the generated commatrix. If the documented matrix differ from the generated one, the test will fail, and the documented matrix should be updated (manually) according to the generated matrix.
The generated artifacts are:
doc-commatrix - The documented communication matrix. communication-matrix - The new generated communication matrix (in case of test failure, documented matrix should be updated to communication-matrix) doc-diff-commatrix - Diff between the documented and new matrices.
Job Failure Risk Analysis for sha: 4e04c0a491303a026c4212c73cf775564b698076
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator Potential external regression detected for High Risk Test analysis --- [sig-architecture] platform pods in ns/openshift-etcd should not exit an excessive amount of times Potential external regression detected for High Risk Test analysis --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (102) are below the historical average (1353): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 4e04c0a491303a026c4212c73cf775564b698076
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 4 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit a moderate amount of times" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit an excessive amount of times" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not fail to start" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-auth] all workloads in ns/openshift-commatrix-test must set the 'openshift.io/required-scc' annotation" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 3 time(s). |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "objects in ns/openshift-commatrix-test should have generation increasing monotonically" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "objects in ns/openshift-commatrix-test should not have too many generations" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "operators in in ns/openshift-commatrix-test should not submit invalid apply statements" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "users in ns/openshift-commatrix-test must not produce too many applies" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "users in ns/openshift-commatrix-test must not produce too many invalid "apply" requests" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "users in ns/openshift-commatrix-test must not produce too many invalid "create" requests" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "users in ns/openshift-commatrix-test must not produce too many invalid "patch" requests" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "users in ns/openshift-commatrix-test must not produce too many invalid "update" requests" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit a moderate amount of times" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit an excessive amount of times" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-architecture] platform pods in ns/openshift-commatrix-test should not fail to start" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-auth] all workloads in ns/openshift-commatrix-test must set the 'openshift.io/required-scc' annotation" is a new test that was not present in all runs against the current commit. |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 3 time(s). |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "objects in ns/openshift-commatrix-test should have generation increasing monotonically" is a new test that was not present in all runs against the current commit. |
| (...showing 20 of 54 rows) |
New tests seen in this PR at sha: 4e04c0a491303a026c4212c73cf775564b698076
- "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit a moderate amount of times" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "[sig-architecture] platform pods in ns/openshift-commatrix-test should not exit an excessive amount of times" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "[sig-architecture] platform pods in ns/openshift-commatrix-test should not fail to start" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "[sig-auth] all workloads in ns/openshift-commatrix-test must set the 'openshift.io/required-scc' annotation" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 24, Pass: 5, Fail: 19, Flake: 0]
- "objects in ns/openshift-commatrix-test should have generation increasing monotonically" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "objects in ns/openshift-commatrix-test should not have too many generations" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "operators in in ns/openshift-commatrix-test should not submit invalid apply statements" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "users in ns/openshift-commatrix-test must not produce too many applies" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "users in ns/openshift-commatrix-test must not produce too many invalid "apply" requests" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "users in ns/openshift-commatrix-test must not produce too many invalid "create" requests" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "users in ns/openshift-commatrix-test must not produce too many invalid "patch" requests" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
- "users in ns/openshift-commatrix-test must not produce too many invalid "update" requests" [Total: 24, Pass: 24, Fail: 0, Flake: 0]
![openshift-trt[bot] avatar](https://avatars.githubusercontent.com/u/111778100?v=4 "Published by a pub.dev verified publisher"){kind=small}
Job Failure Risk Analysis for sha: 55e6e28ef4db373579b90c57488ce81449918dce
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (12) are below the historical average (208): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis --- [sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator Potential external regression detected for High Risk Test analysis --- [sig-node] node-lifecycle detects unexpected not ready node Potential external regression detected for High Risk Test analysis Open Bugs [sig-node] node-lifecycle detects unexpected not ready node failing on azure serial and upgrade jobs --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | High [sig-architecture] platform pods in ns/openshift-multus should not exit an excessive amount of times This test has passed 99.74% of 4988 runs on release 4.19 [Overall] in the last week. Open Bugs Component Readiness: [Networking / multus] [Other] test regressed |
| pull-ci-openshift-origin-main-okd-e2e-gcp | IncompleteTests Tests for this run (15) are below the historical average (48): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 55e6e28ef4db373579b90c57488ce81449918dce
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
New tests seen in this PR at sha: 55e6e28ef4db373579b90c57488ce81449918dce
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 12, Pass: 1, Fail: 11, Flake: 0]
Job Failure Risk Analysis for sha: 7c95ea9a908377190d92fad327c1d353a9d08c44
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (12) are below the historical average (216): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis --- [sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-okd-e2e-gcp | IncompleteTests Tests for this run (15) are below the historical average (37): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 7c95ea9a908377190d92fad327c1d353a9d08c44
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
New tests seen in this PR at sha: 7c95ea9a908377190d92fad327c1d353a9d08c44
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 6, Pass: 0, Fail: 6, Flake: 0]
Job Failure Risk Analysis for sha: 07a0d8cf3af5d59ba86c4238ac0f78b2aa08a5a5
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available This test has passed 96.94% of 3461 runs on release 4.20 [Overall] in the last week. --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack | IncompleteTests Tests for this run (21) are below the historical average (2074): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview | IncompleteTests Tests for this run (21) are below the historical average (2348): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway | IncompleteTests Tests for this run (21) are below the historical average (2236): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | IncompleteTests Tests for this run (21) are below the historical average (1018): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (21) are below the historical average (1204): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia | IncompleteTests Tests for this run (21) are below the historical average (2126): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-okd-e2e-gcp | IncompleteTests Tests for this run (15) are below the historical average (27): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 07a0d8cf3af5d59ba86c4238ac0f78b2aa08a5a5
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 3 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
New tests seen in this PR at sha: 07a0d8cf3af5d59ba86c4238ac0f78b2aa08a5a5
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 12, Pass: 2, Fail: 10, Flake: 0]
Job Failure Risk Analysis for sha: ddbd5e827e57877654c02f3bea23738274689005
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (93) are below the historical average (170): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws | IncompleteTests Tests for this run (23) are below the historical average (2229): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-csi | IncompleteTests Tests for this run (23) are below the historical average (1391): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-disruptive | IncompleteTests Tests for this run (23) are below the historical average (1136): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-cgroupsv2 | IncompleteTests Tests for this run (23) are below the historical average (2247): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones | IncompleteTests Tests for this run (22) are below the historical average (1739): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | IncompleteTests Tests for this run (23) are below the historical average (1449): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-fips | IncompleteTests Tests for this run (23) are below the historical average (2048): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | IncompleteTests Tests for this run (23) are below the historical average (1355): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: ddbd5e827e57877654c02f3bea23738274689005
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 2 time(s). |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 3 time(s). |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 2 time(s). |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 2 time(s). |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 3 time(s). |
New tests seen in this PR at sha: ddbd5e827e57877654c02f3bea23738274689005
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 23, Pass: 11, Fail: 12, Flake: 0]
/approve /retest e2e-aws-ovn-serial-2of2 the e2e-gcp-fips-serial failure looks like it might be a problem?
@sosiouxme: The /retest command does not accept any targets.
The following commands are available to trigger required jobs:
/test e2e-aws-jenkins
/test e2e-aws-ovn-edge-zones
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-image-registry
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-ovn
/test e2e-gcp-ovn-builds
/test e2e-gcp-ovn-image-ecosystem
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi
/test images
/test lint
/test okd-scos-images
/test unit
/test verify
/test verify-deps
The following commands are available to trigger optional jobs:
/test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
/test e2e-agnostic-ovn-cmd
/test e2e-aws
/test e2e-aws-csi
/test e2e-aws-disruptive
/test e2e-aws-etcd-certrotation
/test e2e-aws-etcd-recovery
/test e2e-aws-ovn
/test e2e-aws-ovn-cgroupsv2
/test e2e-aws-ovn-etcd-scaling
/test e2e-aws-ovn-ipsec-serial
/test e2e-aws-ovn-kube-apiserver-rollout
/test e2e-aws-ovn-kubevirt
/test e2e-aws-ovn-single-node
/test e2e-aws-ovn-single-node-serial
/test e2e-aws-ovn-single-node-techpreview
/test e2e-aws-ovn-single-node-techpreview-serial
/test e2e-aws-ovn-single-node-upgrade
/test e2e-aws-ovn-upgrade
/test e2e-aws-ovn-upgrade-rollback
/test e2e-aws-ovn-upi
/test e2e-aws-ovn-virt-techpreview
/test e2e-aws-proxy
/test e2e-azure
/test e2e-azure-ovn-etcd-scaling
/test e2e-azure-ovn-upgrade
/test e2e-baremetalds-kubevirt
/test e2e-external-aws
/test e2e-external-aws-ccm
/test e2e-external-vsphere-ccm
/test e2e-gcp-csi
/test e2e-gcp-disruptive
/test e2e-gcp-fips-serial
/test e2e-gcp-ovn-etcd-scaling
/test e2e-gcp-ovn-rt-upgrade
/test e2e-gcp-ovn-techpreview
/test e2e-gcp-ovn-techpreview-serial
/test e2e-hypershift-conformance
/test e2e-metal-ipi-ovn
/test e2e-metal-ipi-ovn-dualstack
/test e2e-metal-ipi-ovn-dualstack-bgp-local-gw-techpreview
/test e2e-metal-ipi-ovn-dualstack-bgp-techpreview
/test e2e-metal-ipi-ovn-dualstack-local-gateway
/test e2e-metal-ipi-ovn-kube-apiserver-rollout
/test e2e-metal-ipi-serial
/test e2e-metal-ipi-serial-ovn-ipv6
/test e2e-metal-ipi-virtualmedia
/test e2e-metal-ovn-single-node-live-iso
/test e2e-metal-ovn-single-node-with-worker-live-iso
/test e2e-metal-ovn-two-node-arbiter
/test e2e-openstack-ovn
/test e2e-openstack-serial
/test e2e-vsphere-ovn-dualstack-primaryv6
/test e2e-vsphere-ovn-etcd-scaling
/test okd-e2e-gcp
/test okd-scos-e2e-aws-ovn
Use /test all to run the following jobs that were automatically triggered:
pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
pull-ci-openshift-origin-main-e2e-agnostic-ovn-cmd
pull-ci-openshift-origin-main-e2e-aws
pull-ci-openshift-origin-main-e2e-aws-csi
pull-ci-openshift-origin-main-e2e-aws-disruptive
pull-ci-openshift-origin-main-e2e-aws-ovn
pull-ci-openshift-origin-main-e2e-aws-ovn-cgroupsv2
pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones
pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling
pull-ci-openshift-origin-main-e2e-aws-ovn-fips
pull-ci-openshift-origin-main-e2e-aws-ovn-kube-apiserver-rollout
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgrade
pull-ci-openshift-origin-main-e2e-aws-ovn-upgrade
pull-ci-openshift-origin-main-e2e-aws-proxy
pull-ci-openshift-origin-main-e2e-azure
pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling
pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade
pull-ci-openshift-origin-main-e2e-gcp-csi
pull-ci-openshift-origin-main-e2e-gcp-disruptive
pull-ci-openshift-origin-main-e2e-gcp-fips-serial
pull-ci-openshift-origin-main-e2e-gcp-ovn
pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling
pull-ci-openshift-origin-main-e2e-gcp-ovn-rt-upgrade
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade
pull-ci-openshift-origin-main-e2e-hypershift-conformance
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-local-gw-techpreview
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout
pull-ci-openshift-origin-main-e2e-metal-ipi-serial
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6
pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia
pull-ci-openshift-origin-main-e2e-openstack-ovn
pull-ci-openshift-origin-main-e2e-openstack-serial
pull-ci-openshift-origin-main-e2e-vsphere-ovn
pull-ci-openshift-origin-main-e2e-vsphere-ovn-dualstack-primaryv6
pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling
pull-ci-openshift-origin-main-e2e-vsphere-ovn-upi
pull-ci-openshift-origin-main-images
pull-ci-openshift-origin-main-lint
pull-ci-openshift-origin-main-okd-e2e-gcp
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn
pull-ci-openshift-origin-main-okd-scos-images
pull-ci-openshift-origin-main-unit
pull-ci-openshift-origin-main-verify
pull-ci-openshift-origin-main-verify-deps
In response to this:
/approve /retest e2e-aws-ovn-serial-2of2 the e2e-gcp-fips-serial failure looks like it might be a problem?
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.
![openshift-ci[bot] avatar](https://avatars.githubusercontent.com/in/91280?v=4 "Published by a pub.dev verified publisher"){kind=small}
Job Failure Risk Analysis for sha: 17ef2755820869d4d9c7f5dc34e51748d3b8a44b
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-cgroupsv2 | IncompleteTests Tests for this run (24) are below the historical average (2055): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node | IncompleteTests Tests for this run (24) are below the historical average (1735): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling | Low [bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available This test has passed 64.64% of 2596 runs on release 4.20 [Overall] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn | IncompleteTests Tests for this run (103) are below the historical average (1317): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack | IncompleteTests Tests for this run (103) are below the historical average (1258): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway | IncompleteTests Tests for this run (103) are below the historical average (1275): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 | IncompleteTests Tests for this run (103) are below the historical average (1412): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout | IncompleteTests Tests for this run (103) are below the historical average (684): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | IncompleteTests Tests for this run (103) are below the historical average (613): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (103) are below the historical average (682): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia | IncompleteTests Tests for this run (103) are below the historical average (1155): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 17ef2755820869d4d9c7f5dc34e51748d3b8a44b
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 2 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
New tests seen in this PR at sha: 17ef2755820869d4d9c7f5dc34e51748d3b8a44b
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 9, Pass: 3, Fail: 6, Flake: 0]
Job Failure Risk Analysis for sha: d18524c81f9933c909d6bd625c5b9f5e10f3da88
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (93) are below the historical average (245): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Medium [sig-architecture] platform pods in ns/openshift-etcd should not exit an excessive amount of times Potential external regression detected for High Risk Test analysis --- [bz-etcd][invariant] alert/etcdMembersDown should not be at or above info Potential external regression detected for High Risk Test analysis Open Bugs etcd-scaling jobs failing ~60% of the time --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded Potential external regression detected for High Risk Test analysis Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | IncompleteTests Tests for this run (101) are below the historical average (874): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (101) are below the historical average (907): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: d18524c81f9933c909d6bd625c5b9f5e10f3da88
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 5 time(s). |
| pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 5 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 5 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 2 time(s). |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 5 time(s) against the current commit |
New tests seen in this PR at sha: d18524c81f9933c909d6bd625c5b9f5e10f3da88
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 26, Pass: 4, Fail: 22, Flake: 0]
Job Failure Risk Analysis for sha: d5f046c19f5aada4ad691fb30608774c14946df6
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [sig-network] pods should successfully create sandboxes by adding pod to network This test has passed 84.21% of 19 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:hidden Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:micro-downgrade] in the last week. Open Bugs Pod sandbox creation regression adding to pod network --- [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis --- Showing 2 of 4 test results |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | IncompleteTests |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn | IncompleteTests Tests for this run (101) are below the historical average (1528): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack | IncompleteTests Tests for this run (101) are below the historical average (1598): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview | IncompleteTests Tests for this run (103) are below the historical average (1912): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway | IncompleteTests Tests for this run (101) are below the historical average (1524): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 | IncompleteTests Tests for this run (101) are below the historical average (1215): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout | IncompleteTests Tests for this run (101) are below the historical average (796): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | IncompleteTests Tests for this run (101) are below the historical average (704): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (101) are below the historical average (724): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia | IncompleteTests Tests for this run (21) are below the historical average (1432): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-openstack-serial | IncompleteTests Tests for this run (104) are below the historical average (1749): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: d5f046c19f5aada4ad691fb30608774c14946df6
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 3 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn | High - "Find the input image origin_scos-4.20_tools and tag it into the pipeline" is a new test that was not present in all runs against the current commit. |
New tests seen in this PR at sha: d5f046c19f5aada4ad691fb30608774c14946df6
- "Find the input image origin_scos-4.20_tools and tag it into the pipeline" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 8, Pass: 4, Fail: 4, Flake: 0]
Job Failure Risk Analysis for sha: d5f046c19f5aada4ad691fb30608774c14946df6
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [sig-network] pods should successfully create sandboxes by adding pod to network This test has passed 84.21% of 19 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:hidden Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:micro-downgrade] in the last week. Open Bugs Pod sandbox creation regression adding to pod network --- [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis --- Showing 2 of 4 test results |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn | IncompleteTests Tests for this run (101) are below the historical average (1528): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack | IncompleteTests Tests for this run (101) are below the historical average (1598): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-local-gw-techpreview | IncompleteTests Tests for this run (21) are below the historical average (2018): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview | IncompleteTests Tests for this run (103) are below the historical average (1912): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway | IncompleteTests Tests for this run (101) are below the historical average (1524): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 | IncompleteTests Tests for this run (101) are below the historical average (1206): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout | IncompleteTests Tests for this run (101) are below the historical average (796): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial | IncompleteTests Tests for this run (101) are below the historical average (704): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6 | IncompleteTests Tests for this run (101) are below the historical average (724): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia | IncompleteTests Tests for this run (21) are below the historical average (1432): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-openstack-serial | IncompleteTests Tests for this run (104) are below the historical average (1749): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: d5f046c19f5aada4ad691fb30608774c14946df6
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that failed 3 time(s) against the current commit |
| pull-ci-openshift-origin-main-e2e-openstack-serial | High - "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" is a new test that was not present in all runs against the current commit, and also failed 1 time(s). |
| pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn | High - "Find the input image origin_scos-4.20_tools and tag it into the pipeline" is a new test that was not present in all runs against the current commit. |
New tests seen in this PR at sha: d5f046c19f5aada4ad691fb30608774c14946df6
- "Find the input image origin_scos-4.20_tools and tag it into the pipeline" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
- "[sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial]" [Total: 8, Pass: 4, Fail: 4, Flake: 0]