origin icon indicating copy to clipboard operation
origin copied to clipboard

Automated - Update synthetic test data

Open openshift-bot opened this issue 1 year ago • 3 comments

disruptions Information

There were (138) added jobs and (0) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 324 jobs increased and 762 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
image-registry-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 10s 233.33% 4m16.38s 1731.29%
ingress-to-oauth-server-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 9s 350.00% 29.63s 96.23%
ingress-to-console-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 8s 300.00% 24.63s 89.46%
ingress-to-oauth-server-reused-connections 4.16 4.15 amd64 sdn aws ha 144 6s 11900.00% 11s 48.45%
image-registry-reused-connections 4.16 4.15 amd64 sdn aws ha 144 6s 11900.00% 11s 83.33%
cache-kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 8s 190.91% 18s 80.00%
ingress-to-console-reused-connections 4.16 4.15 amd64 sdn aws ha 144 5.85s 485.00% 11s 83.33%
ingress-to-oauth-server-new-connections 4.15 4.14 amd64 ovn gcp ha 736 5.25s 425.00% 19.55s 225.83%
oauth-api-new-connections 4.15 amd64 sdn gcp ha 319 6.1s 205.00% 14s 40.00%
ingress-to-console-new-connections 4.15 4.14 amd64 ovn gcp ha 736 5s 400.00% 15.65s 160.83%
image-registry-new-connections 4.15 4.14 amd64 ovn gcp ha 736 6s 200.00% 22.25s 243.89%
kube-api-new-connections 4.15 amd64 sdn gcp ha 319 7s 133.33% 13.46s 49.56%
oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 133.33% 19.26s 114.00%
openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 133.33% 20.26s 68.83%
cache-openshift-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 133.33% 20.89s 98.01%
kube-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 133.33% 19s 90.00%
cache-oauth-api-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 133.33% 19s 72.73%
kube-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6s 100.00% 18.51s 68.27%
cache-oauth-api-new-connections 4.15 amd64 sdn gcp ha 319 5s 150.00% 14s 97.74%
oauth-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 5s 150.00% 17.65s 194.17%
service-load-balancer-with-pdb-new-connections 4.15 amd64 sdn gcp ha 319 5s 150.00% 16.46s 66.94%
openshift-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6s 100.00% 15s 50.00%
cache-kube-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6s 100.00% 16s 68.42%
ingress-to-console-new-connections 4.16 4.15 amd64 sdn aws ha 144 6s 100.00% 11.57s 92.83%
service-load-balancer-with-pdb-new-connections 4.16 4.16 amd64 ovn gcp ha 1038 7s 75.00% 18s 80.00%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 sdn aws ha 144 6s 100.00% 12.14s 44.35%
image-registry-new-connections 4.16 4.15 amd64 sdn aws ha 144 6s 100.00% 13.14s 119.00%
ingress-to-console-new-connections 4.16 4.15 amd64 ovn gcp ha 489 4.6s 130.00% 33s 266.67%
service-load-balancer-with-pdb-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6.55s 63.75% 14s 40.00%
oauth-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6.55s 63.75% 18s 50.00%
ingress-to-console-new-connections 4.15 4.15 amd64 ovn gcp ha 950 5s 100.00% 14.51s 45.10%
cache-openshift-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 4.25s 112.50% 17.65s 222.67%
cache-kube-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 4s 100.00% 17.6s 252.00%
image-registry-new-connections 4.15 4.15 amd64 ovn gcp ha 950 5s 66.67% 13.51s 50.11%
cache-openshift-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6s 50.00% 15.51s 72.33%
service-load-balancer-with-pdb-new-connections 4.15 4.14 amd64 ovn gcp ha 736 5s 66.67% 12.65s 110.83%
cache-oauth-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 4s 100.00% 15.65s 141.89%
kube-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 4s 100.00% 14.65s 193.00%
cache-oauth-api-new-connections 4.15 4.15 amd64 ovn gcp ha 950 6s 50.00% 16.51s 65.10%
openshift-api-new-connections 4.15 4.14 amd64 ovn gcp ha 736 4s 100.00% 13.65s 127.50%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 ovn gcp ha 489 4s 100.00% 32.24s 360.57%
oauth-api-new-connections 4.16 4.15 amd64 ovn gcp ha 489 4s 100.00% 13.12s 87.43%
service-load-balancer-with-pdb-new-connections 4.16 amd64 sdn gcp ha 279 3s 200.00% 10.44s 74.00%
service-load-balancer-with-pdb-new-connections 4.16 4.15 amd64 ovn gcp ha 489 5s 66.67% 17.12s 144.57%
image-registry-new-connections 4.16 4.15 amd64 ovn gcp ha 489 4.6s 53.33% 32.24s 304.01%
ingress-to-oauth-server-new-connections 4.15 4.14 amd64 sdn azure ha 873 3.4s 70.00% 8s 33.33%
oauth-api-new-connections 4.16 amd64 sdn gcp ha 279 3.1s 55.00% 9.44s 57.33%
cache-openshift-api-reused-connections 4.15 4.15 amd64 ovn azure ha 383 2s 100.00% 3s 50.00%
image-registry-new-connections 4.15 4.14 amd64 sdn azure ha 873 3s 50.00% 10s 42.86%
cache-kube-api-reused-connections 4.16 4.16 amd64 ovn azure ha 353 2s 100.00% 3s 50.00%
kube-api-new-connections 4.16 amd64 sdn gcp ha 279 3s 50.00% 7.22s 80.50%
cache-openshift-api-new-connections 4.16 4.15 amd64 ovn gcp ha 489 3s 50.00% 11.12s 85.33%
cache-kube-api-new-connections 4.16 amd64 sdn gcp ha 279 3s 50.00% 11.44s 128.80%
cache-oauth-api-new-connections 4.16 4.15 amd64 ovn gcp ha 489 3s 50.00% 11.24s 40.68%
kube-api-new-connections 4.16 4.15 amd64 ovn gcp ha 489 3s 50.00% 12s 50.19%
kube-api-reused-connections 4.15 4.15 amd64 ovn azure ha 383 1.9s 90.00% 3s 50.00%
pod-to-service-new-connections 4.15 4.15 amd64 ovn aws ha 135 0s 0.00% 1.66s 66.00%
host-to-pod-new-connections 4.15 4.14 amd64 ovn aws ha 1034 2s 0.00% 8s 33.33%
host-to-service-new-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 2s 34.23%
ci-cluster-network-liveness-new-connections 4.15 4.15 amd64 ovn gcp ha 950 0s 0.00% 8.51s 70.20%
openshift-api-new-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 1.94s 30.20%
ingress-to-console-new-connections 4.15 4.15 amd64 sdn aws ha 307 1s 0.00% 6.94s 247.00%
host-to-pod-reused-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 30.13s 67.39%
image-registry-new-connections 4.15 amd64 sdn gcp ha 319 6.2s 0.00% 17s 88.89%
host-to-host-new-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 3m2.84s 5994.67%
ingress-to-console-new-connections 4.15 amd64 sdn gcp ha 319 5.1s 0.00% 16.64s 177.33%
pod-to-service-new-connections 4.15 4.15 amd64 ovn azure ha 383 0s 0.00% 42.9s 2045.00%
oauth-api-reused-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 2s 100.00%
ingress-to-oauth-server-new-connections 4.15 amd64 sdn gcp ha 319 4.1s 0.00% 15.64s 123.43%
ci-cluster-network-liveness-new-connections 4.15 4.15 amd64 ovn azure ha 383 0s 0.00% 1s 44.93%
image-registry-reused-connections 4.15 4.14 amd64 ovn gcp ha 736 1s 0.00% 1.65s 65.00%
pod-to-pod-reused-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 29.71s 197.10%
pod-to-pod-new-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 29.71s 74.76%
host-to-pod-new-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 29.13s 38.71%
image-registry-reused-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 4.82s 141.00%
image-registry-new-connections 4.15 4.15 amd64 sdn aws ha 307 1s 0.00% 5.88s 194.00%
host-to-service-reused-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 1.94s 30.20%
ingress-to-console-new-connections 4.15 amd64 sdn aws ha 451 0s 0.00% 1.5s 50.00%
image-registry-new-connections 4.15 amd64 sdn aws ha 451 0s 0.00% 12s 43.37%
ingress-to-oauth-server-new-connections 4.15 4.14 amd64 ovn aws ha 1034 1s 0.00% 5.67s 89.00%
ingress-to-oauth-server-new-connections 4.15 amd64 sdn aws ha 451 0s 0.00% 1.5s 50.00%
pod-to-host-new-connections 4.15 amd64 sdn azure ha 230 0s 0.00% 3m3.55s 2522.14%
ingress-to-console-reused-connections 4.15 4.15 amd64 sdn aws ha 307 0s 0.00% 6s 200.00%
ci-cluster-network-liveness-new-connections 4.15 4.14 amd64 ovn aws ha 1034 0s 0.00% 17.67s 341.75%
ci-cluster-network-liveness-new-connections 4.16 amd64 ovn aws single 152 0s 0.00% 15.39s 145.06%
image-registry-reused-connections 4.16 4.16 amd64 sdn aws ha 305 6s 0.00% 18.64s 210.67%
image-registry-new-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 7s 75.00%
image-registry-new-connections 4.16 amd64 sdn gcp ha 279 6s 0.00% 6m44.5s 2257.23%
ingress-to-oauth-server-new-connections 4.16 amd64 sdn gcp ha 279 1s 0.00% 16.44s 311.00%
host-to-service-new-connections 4.16 4.16 amd64 ovn azure ha 353 0s 0.00% 3.44s 72.00%
cache-openshift-api-reused-connections 4.16 amd64 sdn azure ha 243 1s 0.00% 1.58s 58.00%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 ovn aws ha 1116 2s 0.00% 6s 50.00%
openshift-api-reused-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 4.85s 61.67%
pod-to-service-new-connections 4.16 4.16 amd64 ovn azure ha 353 0s 0.00% 7.36s 84.00%
ingress-to-console-new-connections 4.16 amd64 sdn metal ha 113 0s 0.00% 880ms 33.33%
image-registry-new-connections 4.16 4.16 amd64 sdn aws ha 305 6s 0.00% 18.72s 193.42%
ingress-to-oauth-server-new-connections 4.16 amd64 sdn metal ha 113 0s 0.00% 880ms 33.33%
image-registry-new-connections 4.16 amd64 sdn aws ha 391 1s 0.00% 10s 400.00%
image-registry-reused-connections 4.16 amd64 sdn gcp ha 279 0s 0.00% 6m17.2s 37620.00%
openshift-api-new-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 4s 100.00%
kube-api-new-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 3s 36.99%
oauth-api-new-connections 4.16 4.15 amd64 sdn aws ha 144 1s 0.00% 3.57s 153.19%
oauth-api-reused-connections 4.16 4.15 amd64 sdn aws ha 144 0s 0.00% 4.57s 62.06%
ingress-to-console-new-connections 4.16 amd64 sdn gcp ha 279 0s 0.00% 14.22s 184.40%
service-load-balancer-with-pdb-new-connections 4.16 4.16 amd64 ovn azure ha 353 0s 0.00% 2s 100.00%
oauth-api-reused-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 5.85s 46.25%
pod-to-host-new-connections 4.16 4.16 amd64 ovn azure ha 353 0s 0.00% 1s 75.44%
image-registry-new-connections 4.16 4.15 amd64 sdn azure ha 974 1s 0.00% 7.27s 627.00%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 sdn azure ha 974 0s 0.00% 7.27s 627.00%
kube-api-reused-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 5s 150.00%
ingress-to-console-new-connections 4.16 4.15 amd64 sdn azure ha 974 0s 0.00% 6.27s 213.50%
host-to-pod-new-connections 4.16 4.16 amd64 ovn azure ha 353 8s 0.00% 29.92s 199.20%
oauth-api-new-connections 4.16 4.15 amd64 ovn aws ha 1116 1s 0.00% 6s 50.00%
cache-openshift-api-new-connections 4.16 amd64 sdn gcp ha 279 3.1s 0.00% 11.22s 124.40%
image-registry-reused-connections 4.16 4.16 amd64 ovn gcp ha 1038 1s 0.00% 4m5.61s 12180.50%
ci-cluster-network-liveness-new-connections 4.16 4.15 amd64 sdn azure ha 974 0s 0.00% 4.27s 42.33%

alerts Information

There were (1978) added jobs and (1562) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 45 jobs increased and 135 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
AlertmanagerReceiversNotConfigured openshift-monitoring Warning 4.15 4.15 amd64 sdn aws ha 148 2h33m25.2s 39.70% 2h34m9.06s 34.77%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.15 4.15 amd64 ovn gcp ha 241 0s 0.00% 1m16s 31.03%
NodeSystemSaturation openshift-monitoring Warning 4.15 4.15 amd64 ovn gcp ha 241 0s 0.00% 7m46.8s 1912.07%
KubeAggregatedAPIErrors default Warning 4.15 4.14 amd64 sdn azure ha 172 0s 0.00% 24m17.18s 58.84%
TargetDown openshift-cluster-node-tuning-operator Warning 4.15 4.14 amd64 sdn azure ha 172 0s 0.00% 52m25.36s 79.30%
KubeJobFailed openshift-insights Warning 4.15 amd64 sdn aws ha 114 10m47.5s 0.00% 2h35m22.48s 95.53%
NodeSystemSaturation openshift-monitoring Warning 4.15 4.14 amd64 ovn gcp ha 234 0s 0.00% 38.86s 172.13%
TargetDown kube-system Warning 4.16 4.15 amd64 ovn aws ha 225 0s 0.00% 28s 85.19%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.16 4.16 amd64 ovn gcp ha 234 0s 0.00% 6m13.64s 398.99%
TargetDown kube-system Warning 4.16 4.16 amd64 ovn gcp ha 234 0s 0.00% 28s 47.06%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.16 4.15 amd64 ovn aws ha 225 28s 0.00% 1m58s 59.03%
/cc @dgoodwin, @neisw, @DennisPeriquet

openshift-bot avatar Jan 26 '24 01:01 openshift-bot

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node-serial 3574ba9fa8714675be0b67aa616801375c0b77ec link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-agnostic-ovn-cmd 3574ba9fa8714675be0b67aa616801375c0b77ec link false /test e2e-agnostic-ovn-cmd
ci/prow/e2e-gcp-ovn 3574ba9fa8714675be0b67aa616801375c0b77ec link true /test e2e-gcp-ovn
ci/prow/e2e-aws-ovn-single-node-upgrade 3574ba9fa8714675be0b67aa616801375c0b77ec link false /test e2e-aws-ovn-single-node-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Feb 02 '24 04:02 openshift-ci[bot]

/lgtm

dgoodwin avatar Feb 02 '24 11:02 dgoodwin

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Feb 02 '24 11:02 openshift-ci[bot]

Job Failure Risk Analysis for sha: 3574ba9fa8714675be0b67aa616801375c0b77ec

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (100) are below the historical average (1925): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Mar 05 '24 16:03 openshift-trt-bot

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-merge-robot avatar Mar 05 '24 16:03 openshift-merge-robot

/close

Seems old and stale at this point...

neisw avatar Mar 05 '24 16:03 neisw

@neisw: Closed this PR.

In response to this:

/close

Seems old and stale at this point...

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci[bot] avatar Mar 05 '24 16:03 openshift-ci[bot]