origin icon indicating copy to clipboard operation
origin copied to clipboard

NO-ISSUE: Automated - Update synthetic test data

Open DennisPeriquet opened this issue 1 year ago • 6 comments

disruptions Information

There were (68) added jobs and (80) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 285 jobs increased and 728 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
cache-oauth-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 5.8s 274.19% 13.9s 453.78%
cache-oauth-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 5.9s 131.37% 14.9s 324.50%
oauth-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 5.8s 127.45% 14.48s 382.67%
oauth-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 7s 75.00% 14.9s 230.38%
metrics-api-reused-connections 4.17 4.16 amd64 ovn gcp ha 174 3.7s 184.62% 10s 45.56%
service-load-balancer-with-pdb-new-connections 4.17 4.16 amd64 ovn gcp ha 458 2s 100.00% 9.29s 40.97%
kube-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 3s 50.00% 4.58s 52.67%
metrics-api-reused-connections 4.16 4.16 amd64 sdn aws ha 181 1s 81.82% 6.2s 520.00%
metrics-api-reused-connections 4.16 4.16 amd64 ovn azure ha 155 3.3s 0.00% 7s 51.84%
metrics-api-new-connections 4.16 4.16 amd64 sdn aws ha 181 1s 0.00% 6.6s 560.00%
kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4.27s 113.50%
openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4.27s 67.45%
cache-oauth-api-new-connections 4.16 4.15 amd64 ovn gcp ha 661 1s 0.00% 2s 55.04%
cache-openshift-api-reused-connections 4.16 4.15 amd64 sdn azure ha 946 2s 0.00% 4s 33.33%
cache-kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
ingress-to-oauth-server-new-connections 4.16 4.16 amd64 sdn aws ha 485 1s 0.00% 4.32s 60.00%
ingress-to-console-reused-connections 4.16 4.16 amd64 sdn aws ha 485 0s 0.00% 6s 252.94%
metrics-api-new-connections 4.16 4.15 amd64 ovn gcp ha 208 1s 0.00% 3.86s 31.29%
cache-oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 56.86%
cache-kube-api-reused-connections 4.16 4.16 amd64 ovn gcp ha 874 0s 0.00% 1s 81.82%
metrics-api-new-connections 4.16 4.16 amd64 ovn gcp ha 335 1.3s 0.00% 6s 100.00%
cache-openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
metrics-api-reused-connections 4.16 4.15 amd64 ovn aws ha 345 1s 0.00% 6.24s 524.00%
ingress-to-console-new-connections 4.16 4.16 amd64 sdn aws ha 485 1s 0.00% 6s 100.00%
service-load-balancer-with-pdb-new-connections 4.16 4.15 amd64 sdn azure ha 946 1s 0.00% 3.55s 40.32%
metrics-api-new-connections 4.16 4.15 amd64 ovn aws ha 345 1s 0.00% 6.12s 350.00%
oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
ci-cluster-network-liveness-new-connections 4.17 4.17 amd64 ovn gcp ha 375 0s 0.00% 3s 200.00%
host-to-service-new-connections 4.17 4.17 amd64 ovn azure ha 143 0s 0.00% 1s 96.08%
cache-oauth-api-new-connections 4.17 4.16 amd64 ovn azure ha 560 4s 0.00% 10.82s 50.07%
oauth-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3.43s 32.43%
cache-oauth-api-reused-connections 4.17 4.16 amd64 ovn azure ha 560 4s 0.00% 9.41s 31.79%
image-registry-new-connections 4.17 4.16 amd64 ovn aws ha 829 1s 0.00% 3.72s 42.53%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 0s 0.00% 1.58s 209.80%
cache-openshift-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 2s 0.00% 3s 50.00%
kube-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%
host-to-pod-new-connections 4.17 4.17 amd64 ovn aws ha 196 1s 0.00% 4.05s 106.63%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%
ingress-to-console-reused-connections 4.17 amd64 ovn aws external 176 0s 0.00% 15.25s 205.00%
ingress-to-console-new-connections 4.17 amd64 ovn aws external 176 0s 0.00% 16.25s 204.88%
image-registry-new-connections 4.17 4.17 amd64 ovn aws ha 196 1s 0.00% 6.1s 106.08%
cache-openshift-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3s 88.68%
cache-kube-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3.43s 71.50%
openshift-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 4.43s 121.50%
cache-oauth-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%

alerts Information

There were (2160) added jobs and (3722) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 27 jobs increased and 324 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
TargetDown kube-system Warning 4.16 4.16 amd64 ovn azure ha 182 0s 0.00% 28s 42.86%
TargetDown kube-system Warning 4.16 4.16 amd64 sdn aws ha 200 0s 0.00% 28s 122.22%
TargetDown kube-system Warning 4.17 4.16 amd64 ovn aws ha 263 0s 0.00% 28s 104.08%
KubeAggregatedAPIErrors default Warning 4.17 4.17 amd64 ovn azure ha 131 0s 0.00% 41m31.2s 272.80%
OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.17 amd64 ovn aws ha 151 0s 0.00% 42m39s 52.70%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn aws ha 151 0s 0.00% 3m11s 36.27%
etcdGRPCRequestsSlow openshift-etcd Critical 4.17 4.17 amd64 ovn azure ha 131 0s 0.00% 4.2s 233.33%
/cc @dgoodwin, @neisw, @DennisPeriquet

DennisPeriquet avatar May 17 '24 17:05 DennisPeriquet

@DennisPeriquet: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (68) added jobs and (80) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 285 jobs increased and 728 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
cache-oauth-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 5.8s 274.19% 13.9s 453.78%
cache-oauth-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 5.9s 131.37% 14.9s 324.50%
oauth-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 5.8s 127.45% 14.48s 382.67%
oauth-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 7s 75.00% 14.9s 230.38%
metrics-api-reused-connections 4.17 4.16 amd64 ovn gcp ha 174 3.7s 184.62% 10s 45.56%
service-load-balancer-with-pdb-new-connections 4.17 4.16 amd64 ovn gcp ha 458 2s 100.00% 9.29s 40.97%
kube-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 3s 50.00% 4.58s 52.67%
metrics-api-reused-connections 4.16 4.16 amd64 sdn aws ha 181 1s 81.82% 6.2s 520.00%
metrics-api-reused-connections 4.16 4.16 amd64 ovn azure ha 155 3.3s 0.00% 7s 51.84%
metrics-api-new-connections 4.16 4.16 amd64 sdn aws ha 181 1s 0.00% 6.6s 560.00%
kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4.27s 113.50%
openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4.27s 67.45%
cache-oauth-api-new-connections 4.16 4.15 amd64 ovn gcp ha 661 1s 0.00% 2s 55.04%
cache-openshift-api-reused-connections 4.16 4.15 amd64 sdn azure ha 946 2s 0.00% 4s 33.33%
cache-kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
ingress-to-oauth-server-new-connections 4.16 4.16 amd64 sdn aws ha 485 1s 0.00% 4.32s 60.00%
ingress-to-console-reused-connections 4.16 4.16 amd64 sdn aws ha 485 0s 0.00% 6s 252.94%
metrics-api-new-connections 4.16 4.15 amd64 ovn gcp ha 208 1s 0.00% 3.86s 31.29%
cache-oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 56.86%
cache-kube-api-reused-connections 4.16 4.16 amd64 ovn gcp ha 874 0s 0.00% 1s 81.82%
metrics-api-new-connections 4.16 4.16 amd64 ovn gcp ha 335 1.3s 0.00% 6s 100.00%
cache-openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
metrics-api-reused-connections 4.16 4.15 amd64 ovn aws ha 345 1s 0.00% 6.24s 524.00%
ingress-to-console-new-connections 4.16 4.16 amd64 sdn aws ha 485 1s 0.00% 6s 100.00%
service-load-balancer-with-pdb-new-connections 4.16 4.15 amd64 sdn azure ha 946 1s 0.00% 3.55s 40.32%
metrics-api-new-connections 4.16 4.15 amd64 ovn aws ha 345 1s 0.00% 6.12s 350.00%
oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 874 1s 0.00% 4s 100.00%
ci-cluster-network-liveness-new-connections 4.17 4.17 amd64 ovn gcp ha 375 0s 0.00% 3s 200.00%
host-to-service-new-connections 4.17 4.17 amd64 ovn azure ha 143 0s 0.00% 1s 96.08%
cache-oauth-api-new-connections 4.17 4.16 amd64 ovn azure ha 560 4s 0.00% 10.82s 50.07%
oauth-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3.43s 32.43%
cache-oauth-api-reused-connections 4.17 4.16 amd64 ovn azure ha 560 4s 0.00% 9.41s 31.79%
image-registry-new-connections 4.17 4.16 amd64 ovn aws ha 829 1s 0.00% 3.72s 42.53%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn azure ha 143 0s 0.00% 1.58s 209.80%
cache-openshift-api-reused-connections 4.17 4.17 amd64 ovn azure ha 143 2s 0.00% 3s 50.00%
kube-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%
host-to-pod-new-connections 4.17 4.17 amd64 ovn aws ha 196 1s 0.00% 4.05s 106.63%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%
ingress-to-console-reused-connections 4.17 amd64 ovn aws external 176 0s 0.00% 15.25s 205.00%
ingress-to-console-new-connections 4.17 amd64 ovn aws external 176 0s 0.00% 16.25s 204.88%
image-registry-new-connections 4.17 4.17 amd64 ovn aws ha 196 1s 0.00% 6.1s 106.08%
cache-openshift-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3s 88.68%
cache-kube-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 3.43s 71.50%
openshift-api-new-connections 4.17 4.16 amd64 ovn gcp ha 458 1s 0.00% 4.43s 121.50%
cache-oauth-api-new-connections 4.17 4.17 amd64 ovn aws ha 196 0s 0.00% 1s 316.67%

alerts Information

There were (2160) added jobs and (3722) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 27 jobs increased and 324 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
TargetDown kube-system Warning 4.16 4.16 amd64 ovn azure ha 182 0s 0.00% 28s 42.86%
TargetDown kube-system Warning 4.16 4.16 amd64 sdn aws ha 200 0s 0.00% 28s 122.22%
TargetDown kube-system Warning 4.17 4.16 amd64 ovn aws ha 263 0s 0.00% 28s 104.08%
KubeAggregatedAPIErrors default Warning 4.17 4.17 amd64 ovn azure ha 131 0s 0.00% 41m31.2s 272.80%
OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.17 amd64 ovn aws ha 151 0s 0.00% 42m39s 52.70%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn aws ha 151 0s 0.00% 3m11s 36.27%
etcdGRPCRequestsSlow openshift-etcd Critical 4.17 4.17 amd64 ovn azure ha 131 0s 0.00% 4.2s 233.33%
/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar May 17 '24 17:05 openshift-ci-robot

The same thing happened so I created this PR manually.

DennisPeriquet avatar May 20 '24 11:05 DennisPeriquet

the only relevant test for this PR is the unit test

/override ci/prow/e2e-aws-ovn-serial

DennisPeriquet avatar May 20 '24 11:05 DennisPeriquet

@DennisPeriquet: Overrode contexts on behalf of DennisPeriquet: ci/prow/e2e-aws-ovn-serial

In response to this:

the only relevant test for this PR is the unit test

/override ci/prow/e2e-aws-ovn-serial

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar May 20 '24 11:05 openshift-ci[bot]

/lgtm

neisw avatar May 23 '24 12:05 neisw

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: DennisPeriquet, neisw

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • ~~OWNERS~~ [DennisPeriquet,neisw]

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar May 23 '24 12:05 openshift-ci[bot]

/retest-required

Remaining retests: 0 against base HEAD f9a573a84d345a55791ff4630b1b2bc2a7233f15 and 2 for PR HEAD 4c82a7fefc48d2372bee09e1b3c86cdce14d2a8b in total

openshift-ci-robot avatar May 23 '24 16:05 openshift-ci-robot

Job Failure Risk Analysis for sha: 4c82a7fefc48d2372bee09e1b3c86cdce14d2a8b

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-gcp-ovn Medium
[sig-storage] Multi-AZ Cluster Volumes should schedule pods in the same zones as statically provisioned PVs [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 91.60% of 714 runs on release 4.17 [Overall] in the last week.
---
[sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] should test that deleting the PV before the pod does not cause pod deletion to fail on PD detach [Skipped:NoOptionalCapabilities] [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 93.42% of 714 runs on release 4.17 [Overall] in the last week.

Open Bugs
4.17 ci failures: persistentvolumes "gce-" is forbidden ... GCE PD ...disk is not found

openshift-trt-bot avatar May 23 '24 19:05 openshift-trt-bot

/test e2e-gcp-ovn

DennisPeriquet avatar May 26 '24 17:05 DennisPeriquet

/retest-required

Remaining retests: 0 against base HEAD ff8fc0685363c6fa343e505e415d339b570bbc9f and 1 for PR HEAD 4c82a7fefc48d2372bee09e1b3c86cdce14d2a8b in total

openshift-ci-robot avatar May 27 '24 11:05 openshift-ci-robot

/override ci/prow/e2e-gcp-ovn

DennisPeriquet avatar May 27 '24 18:05 DennisPeriquet

@DennisPeriquet: Overrode contexts on behalf of DennisPeriquet: ci/prow/e2e-gcp-ovn

In response to this:

/override ci/prow/e2e-gcp-ovn

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar May 27 '24 18:05 openshift-ci[bot]

/retest-required

Remaining retests: 0 against base HEAD 04df82ba3ca34056ae01f359665d3863f14b98de and 0 for PR HEAD 4c82a7fefc48d2372bee09e1b3c86cdce14d2a8b in total

openshift-ci-robot avatar May 28 '24 11:05 openshift-ci-robot

/test lint

DennisPeriquet avatar May 28 '24 12:05 DennisPeriquet

/hold

Revision 4c82a7fefc48d2372bee09e1b3c86cdce14d2a8b was retested 3 times: holding

openshift-ci-robot avatar May 28 '24 13:05 openshift-ci-robot

/test lint

DennisPeriquet avatar May 28 '24 14:05 DennisPeriquet

/override ci/prow/e2e-aws-ovn-upgrade /override ci/prow/e2e-aws-csi /override ci/prow/e2e-aws-ovn-single-node-upgrade /override ci/prow/e2e-aws-ovn-single-node

DennisPeriquet avatar May 28 '24 17:05 DennisPeriquet

/hold cancel

DennisPeriquet avatar May 28 '24 17:05 DennisPeriquet

@DennisPeriquet: Overrode contexts on behalf of DennisPeriquet: ci/prow/e2e-aws-csi, ci/prow/e2e-aws-ovn-single-node, ci/prow/e2e-aws-ovn-single-node-upgrade, ci/prow/e2e-aws-ovn-upgrade

In response to this:

/override ci/prow/e2e-aws-ovn-upgrade /override ci/prow/e2e-aws-csi /override ci/prow/e2e-aws-ovn-single-node-upgrade /override ci/prow/e2e-aws-ovn-single-node

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar May 28 '24 17:05 openshift-ci[bot]

the only test that really tests these changes is the 'unit' test.

/override ci/prow/e2e-aws-ovn-edge-zones /override ci/prow/e2e-aws-ovn-fips /override ci/prow/e2e-aws-ovn-serial /override ci/prow/e2e-gcp-ovn /override ci/prow/e2e-gcp-ovn-upgrade /override ci/prow/e2e-metal-ipi-ovn-ipv6

DennisPeriquet avatar May 28 '24 19:05 DennisPeriquet

@DennisPeriquet: Overrode contexts on behalf of DennisPeriquet: ci/prow/e2e-aws-ovn-edge-zones, ci/prow/e2e-aws-ovn-fips, ci/prow/e2e-aws-ovn-serial, ci/prow/e2e-gcp-ovn, ci/prow/e2e-gcp-ovn-upgrade, ci/prow/e2e-metal-ipi-ovn-ipv6

In response to this:

the only test that really tests these changes is the 'unit' test.

/override ci/prow/e2e-aws-ovn-edge-zones /override ci/prow/e2e-aws-ovn-fips /override ci/prow/e2e-aws-ovn-serial /override ci/prow/e2e-gcp-ovn /override ci/prow/e2e-gcp-ovn-upgrade /override ci/prow/e2e-metal-ipi-ovn-ipv6

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar May 28 '24 19:05 openshift-ci[bot]

@DennisPeriquet: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar May 28 '24 20:05 openshift-ci[bot]