origin icon indicating copy to clipboard operation
origin copied to clipboard

NO-ISSUE: Automated - Update synthetic test data

Open openshift-bot opened this issue 1 year ago • 6 comments

disruptions Information

There were (2260) added jobs and (276) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 295 jobs increased and 380 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
kube-api-http2-service-network-reused-connections 4.17 4.16 amd64 ovn azure ha 124 1m41.5s 144.58% 2m1.77s 190.62%
oauth-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 49s 4160.87% 58.97s 1374.25%
openshift-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 47s 4600.00% 55s 1275.00%
kube-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 44.85s 4385.00% 52s 1200.00%
kube-api-http1-service-network-new-connections 4.17 4.16 amd64 ovn azure ha 124 1m36.1s 75.05% 2m35.54s 182.90%
cache-oauth-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 40.85s 3985.00% 49s 914.49%
cache-kube-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 39s 3800.00% 46.97s 1074.25%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 39s 1850.00% 45.97s 819.40%
kube-api-http1-service-network-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m5.3s 129.93% 1h21m20.71s 16799.97%
openshift-api-http2-internal-lb-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 52.3s 226.87% 1h17m57.04s 29131.50%
metrics-api-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 39s 1200.00% 50s 525.00%
kube-api-http1-internal-lb-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m20s 80.38% 1h21m20.19s 10776.29%
kube-api-http2-service-network-new-connections 4.17 4.16 amd64 ovn azure ha 124 1m36.55s 55.98% 2m23.32s 128.29%
kube-api-http2-service-network-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m3.3s 118.65% 1h19m27.09s 16343.91%
kube-api-http1-service-network-reused-connections 4.17 4.16 amd64 ovn azure ha 124 1m0.8s 129.43% 1m47.94s 301.26%
kube-api-http2-service-network-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 53.15s 166.42% 1h30m6.81s 26947.57%
openshift-api-http2-internal-lb-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m18s 74.11% 1h23m7.07s 10992.24%
openshift-api-http2-service-network-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 53.15s 142.69% 1h1m24.54s 16663.15%
openshift-api-http2-service-network-new-connections 4.17 4.16 amd64 ovn azure ha 124 1m39.7s 44.91% 2m45.31s 136.97%
kube-api-http2-internal-lb-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m15.15s 67.75% 1h48m44.94s 14412.77%
kube-api-http2-internal-lb-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 50.45s 143.13% 1h37m23.28s 27791.55%
kube-api-http1-internal-lb-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 50.45s 140.24% 1h16m45.59s 21831.38%
openshift-api-http2-service-network-new-connections 4.17 4.17 amd64 ovn gcp ha 138 1m1s 91.52% 1h29m52.17s 16766.34%
kube-api-http1-service-network-reused-connections 4.17 4.17 amd64 ovn gcp ha 138 50.15s 131.11% 56m4.76s 15236.19%
service-load-balancer-with-pdb-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 22s 633.33% 30.94s 214.75%
oauth-api-reused-connections 4.17 amd64 ovn metal ha 257 17s 750.00% 49.32s 83.21%
metrics-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 5s 150.00% 10.46s 76.39%
ingress-to-console-new-connections 4.17 amd64 ovn metal compact 112 3.9s 168.97% 14.45s 49.43%
oauth-api-new-connections 4.17 4.16 arm64 ovn azure ha 117 6s 53.85% 14.52s 51.88%
service-load-balancer-with-pdb-new-connections 4.17 4.16 amd64 ovn gcp ha 846 5s 66.67% 12s 71.43%
metrics-api-reused-connections 4.17 amd64 ovn metal compact 112 2.45s 145.00% 18s 800.00%
oauth-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 6.1s 31.18% 18.56s 111.15%
kube-api-reused-connections 4.17 amd64 ovn azure ha 422 2s 110.53% 2s 102.02%
ingress-to-console-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 2s 100.00% 7.97s 181.63%
metrics-api-new-connections 4.17 4.16 amd64 ovn azure ha 932 2s 100.00% 10s 66.67%
metrics-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 101 2s 100.00% 6s 500.00%
image-registry-new-connections 4.17 4.16 heterogeneous ovn gcp ha 222 1.95s 95.00% 3.79s 89.50%
kube-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 900.00% 6.58s 558.00%
oauth-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 900.00% 2.79s 39.50%
cache-openshift-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 0s 0.00% 5.28s 173.58%
cache-oauth-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 2.89s 44.50%
oauth-api-new-connections 4.17 heterogeneous ovn aws ha 489 0s 0.00% 1s 117.39%
ingress-to-console-reused-connections 4.17 amd64 ovn metal ha 163 1s 0.00% 1m38.18s 4809.00%
cache-openshift-api-reused-connections 4.17 amd64 ovn azure ha 422 1s 0.00% 2.79s 181.82%
openshift-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 950ms 0.00% 4.79s 163.19%
image-registry-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 2s 0.00% 8.97s 124.25%
openshift-api-reused-connections 4.17 4.16 heterogeneous ovn azure ha 219 2s 0.00% 5.28s 32.00%
openshift-api-new-connections 4.17 4.16 amd64 ovn gcp ha 846 1s 0.00% 4s 33.33%
cache-oauth-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 6s 0.00% 17.74s 97.11%
oauth-api-new-connections 4.17 amd64 ovn metal ha 257 3s 0.00% 41s 41.38%
metrics-api-reused-connections 4.17 4.16 heterogeneous ovn gcp ha 222 1s 0.00% 7.16s 79.00%
cache-openshift-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 101 1s 0.00% 2s 122.22%
pod-to-service-new-connections 4.17 4.17 amd64 ovn aws single 586 6s 0.00% 55.3s 293.87%
cache-kube-api-new-connections 4.17 4.16 amd64 ovn azure ha 932 0s 0.00% 5.69s 469.00%
oauth-api-reused-connections 4.17 arm64 ovn aws ha 573 0s 0.00% 1.56s 56.00%
ingress-to-console-reused-connections 4.17 4.16 heterogeneous ovn gcp ha 222 1s 0.00% 1.79s 79.00%
ingress-to-oauth-server-new-connections 4.17 4.17 amd64 ovn gcp ha 1004 1s 0.00% 8s 166.67%
host-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 586 0s 0.00% 45.3s 784.77%
openshift-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 2.89s 44.50%
oauth-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 0s 0.00% 4s 300.00%
cache-oauth-api-new-connections 4.17 4.16 amd64 ovn gcp ha 846 1s 0.00% 5s 66.67%
host-to-service-new-connections 4.17 4.17 amd64 ovn aws single 586 750ms 0.00% 45.45s 717.45%
service-load-balancer-with-pdb-new-connections 4.17 4.16 amd64 ovn azure ha 932 1s 0.00% 8s 337.16%
ingress-to-console-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 0.00% 5s 66.67%
image-registry-reused-connections 4.17 4.16 heterogeneous ovn gcp ha 222 1s 0.00% 1.79s 79.00%
image-registry-reused-connections 4.17 4.16 amd64 ovn gcp ha 846 1s 0.00% 2s 100.00%
kube-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 101 0s 0.00% 2s 100.00%
cache-kube-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 2.89s 44.50%
openshift-api-new-connections 4.17 amd64 ovn metal ha 163 0s 0.00% 1m49.96s 362.79%
image-registry-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 0.00% 4s 33.33%
openshift-api-new-connections 4.17 4.16 arm64 ovn azure ha 117 0s 0.00% 6.84s 242.00%
kube-api-new-connections 4.17 arm64 ovn aws ha 573 0s 0.00% 1s 63.93%
openshift-api-new-connections 4.17 heterogeneous ovn azure ha 193 400ms 0.00% 4s 100.00%
cache-openshift-api-new-connections 4.17 4.16 arm64 ovn azure ha 117 200ms 0.00% 5.36s 587.18%
openshift-api-http2-internal-lb-reused-connections 4.17 4.16 amd64 ovn azure ha 124 1m3.7s 0.00% 1m49.08s 102.60%
kube-api-http2-internal-lb-reused-connections 4.17 4.16 amd64 ovn azure ha 124 59.7s 0.00% 1m52.77s 98.61%
metrics-api-reused-connections 4.17 4.16 amd64 ovn azure ha 932 2.45s 0.00% 8.38s 39.67%
kube-api-new-connections 4.17 heterogeneous ovn aws ha 489 0s 0.00% 1s 117.39%
ingress-to-oauth-server-new-connections 4.17 4.17 amd64 ovn aws ha 713 1s 0.00% 4.88s 68.86%
ingress-to-oauth-server-new-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 0.00% 4.79s 59.67%
ingress-to-oauth-server-reused-connections 4.17 amd64 ovn aws single 429 7s 0.00% 11.72s 46.50%
cache-openshift-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 3s 50.00%
cache-openshift-api-new-connections 4.17 amd64 ovn metal ha 163 0s 0.00% 1m47.62s 412.48%
ingress-to-console-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 0s 0.00% 2.64s 183.87%
ingress-to-console-new-connections 4.17 amd64 ovn aws external 745 0s 0.00% 16s 60.00%
image-registry-new-connections 4.17 heterogeneous ovn azure ha 193 0s 0.00% 2s 112.77%
kube-api-new-connections 4.17 4.16 amd64 ovn gcp ha 846 1s 0.00% 5s 66.67%
ingress-to-console-reused-connections 4.17 amd64 ovn aws external 745 0s 0.00% 12.24s 36.00%
cache-oauth-api-new-connections 4.17 4.16 heterogeneous ovn gcp ha 222 0s 0.00% 2.79s 50.00%
oauth-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 101 1s 0.00% 3s 200.00%
metrics-api-new-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 18.78s 49.40%
oauth-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 14s 0.00% 24.97s 2397.00%
kube-api-new-connections 4.17 heterogeneous ovn azure ha 193 1s 0.00% 2.08s 108.00%
host-to-service-new-connections 4.17 4.16 arm64 ovn azure ha 117 0s 0.00% 4.36s 336.00%
kube-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 222 1s 0.00% 2s 100.00%
image-registry-reused-connections 4.17 amd64 ovn metal ha 163 1s 0.00% 1m40.04s 8753.10%
cache-openshift-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 2s 0.00% 3s 200.00%
service-load-balancer-with-pdb-new-connections 4.17 4.16 arm64 ovn azure ha 117 1s 0.00% 2.68s 50.56%
openshift-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 1s 0.00% 5.82s 98.63%
kube-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 219 1s 0.00% 6s 109.79%
pod-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 586 5.75s 0.00% 55.3s 514.44%
kube-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 11s 0.00% 14s 1300.00%
metrics-api-reused-connections 4.17 amd64 ovn metal ha 163 0s 0.00% 1m41.9s 1852.11%
cache-oauth-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 2s 0.00% 11.97s 1097.00%
cache-kube-api-reused-connections 4.17 amd64 ovn metal ha 163 0s 0.00% 1m38.8s 1238.75%
kube-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 2.89s 44.50%
oauth-api-new-connections 4.17 4.16 amd64 ovn gcp ha 846 1s 0.00% 5s 66.67%
openshift-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 14s 0.00% 18s 1700.00%
ingress-to-console-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 1s 0.00% 4.97s 397.00%
cache-kube-api-reused-connections 4.17 4.17 amd64 ovn gcp ha 1004 2s 0.00% 3s 200.00%
ingress-to-oauth-server-new-connections 4.17 4.16 amd64 ovn azure ha 932 0s 0.00% 8.69s 769.00%
oauth-api-reused-connections 4.17 amd64 ovn metal compact 112 1s 0.00% 2.89s 44.50%
ingress-to-console-new-connections 4.17 4.16 amd64 ovn azure ha 932 0s 0.00% 8s 700.00%
metrics-api-new-connections 4.17 4.16 heterogeneous ovn gcp ha 222 2s 0.00% 6.79s 69.75%
kube-api-new-connections 4.17 4.16 arm64 ovn azure ha 117 1s 0.00% 5.36s 436.00%
metrics-api-new-connections 4.17 amd64 ovn metal ha 163 0s 0.00% 1m50.96s 418.99%
ingress-to-console-new-connections 4.17 amd64 ovn aws single 429 0s 0.00% 2s 100.00%

alerts Information

There were (9162) added jobs and (5778) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 40 jobs increased and 273 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
CannotRetrieveUpdates openshift-cluster-version Warning 4.17 ppc64le ovn libvirt ha 120 33m10.8s 120.10% 45m50.48s 100.44%
AlertmanagerReceiversNotConfigured openshift-monitoring Warning 4.17 ppc64le ovn libvirt ha 120 1h6m10.7s 32.22% 1h18m37.8s 34.81%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 155 1m11.4s 92.97% 10m23.6s 608.64%
KubeJobFailed openshift-insights Warning 4.17 amd64 ovn aws ha 154 0s 0.00% 3h16m13.64s 73.37%
CoreDNSErrorsHigh openshift-dns Warning 4.17 ppc64le ovn libvirt ha 120 0s 0.00% 1m58s 114.16%
AlertmanagerReceiversNotConfigured openshift-monitoring Warning 4.17 4.17 amd64 ovn gcp ha 254 1h52m4.7s 0.00% 2h33m14.94s 36.97%
etcdHighCommitDurations openshift-etcd Warning 4.17 4.16 amd64 ovn azure ha 231 29s 0.00% 28m43.8s 277.70%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 155 0s 0.00% 4m33.52s 158.33%
NodeSystemSaturation openshift-monitoring Warning 4.17 amd64 ovn metal ha 155 8.4s 0.00% 20m46.96s 76.17%
/cc @dgoodwin, @neisw, @DennisPeriquet

openshift-bot avatar Aug 02 '24 01:08 openshift-bot

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (0) added jobs and (252) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 229 jobs increased and 868 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
host-to-service-new-connections 4.17 4.17 amd64 ovn aws single 174 4.35s 335.00% 49.89s 797.30%
host-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 174 4s 400.00% 49.16s 860.16%
ingress-to-console-new-connections 4.16 4.15 amd64 sdn metal ha 101 8s 60.00% 23s 34.90%
cache-openshift-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 252.94% 8.62s 788.66%
cache-oauth-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 200.00% 8.62s 762.00%
kube-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 200.00% 11.24s 1024.00%
oauth-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 76.47% 11.24s 479.38%
cache-kube-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 62.16% 8.62s 337.56%
kube-api-reused-connections 4.17 amd64 ovn azure ha 447 2s 110.53% 3s 203.03%
service-load-balancer-with-pdb-new-connections 4.16 4.15 amd64 sdn gcp ha 103 2s 100.00% 2.98s 40.57%
openshift-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 4s 33.33% 7.67s 86.17%
openshift-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 3s 50.00% 14.2s 87.83%
kube-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 4s 33.33% 7.89s 91.50%
kube-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 1s 900.00% 4.22s 322.00%
oauth-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 1s 900.00% 2.74s 37.00%
kube-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 3s 36.36% 7.4s 85.00%
ingress-to-console-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 1.7s 70.00% 4s 33.33%
image-registry-new-connections 4.16 4.15 heterogeneous ovn aws ha 328 1s 0.00% 2s 30.72%
kube-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6s 0.00% 11.6s 38.76%
oauth-api-new-connections 4.16 amd64 ovn gcp ha 544 1s 0.00% 2s 104.08%
cache-kube-api-new-connections 4.16 arm64 ovn azure ha 154 0s 0.00% 1s 38.89%
ingress-to-oauth-server-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 30.4s 1753.66%
cache-oauth-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 9.28s 212.46%
cache-openshift-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 11.8s 201.02%
cache-oauth-api-new-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85%
pod-to-pod-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67%
openshift-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6s 0.00% 11.6s 38.76%
azure-network-liveness-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67%
ingress-to-console-reused-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 1s 56.25%
host-to-service-new-connections 4.16 heterogeneous ovn azure ha 317 0s 0.00% 840ms 33.33%
cache-kube-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 6.67s 390.44%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 sdn metal ha 101 1s 0.00% 2s 73.91%
image-registry-new-connections 4.16 arm64 ovn aws ha 652 1s 0.00% 3.49s 36.86%
oauth-api-reused-connections 4.16 amd64 ovn azure ha 525 2.8s 0.00% 10s 236.70%
cache-kube-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 3.4s 165.62%
host-to-service-new-connections 4.16 amd64 sdn vsphere ha 109 2s 0.00% 2.92s 41.06%
metrics-api-reused-connections 4.16 4.15 amd64 sdn azure ha 112 5.45s 0.00% 12.56s 32.49%
openshift-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 1.61s 61.00%
pod-to-host-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 14.24s 641.67%
openshift-api-new-connections 4.16 amd64 ovn metal ha 207 0s 0.00% 940ms 347.62%
openshift-api-new-connections 4.16 arm64 ovn azure ha 154 0s 0.00% 1s 38.89%
pod-to-host-reused-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67%
host-to-host-reused-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67%
cache-oauth-api-reused-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85%
host-to-service-reused-connections 4.16 4.15 amd64 sdn aws ha 191 0s 0.00% 2s 545.16%
kube-api-new-connections 4.16 amd64 sdn azure ha 117 200ms 0.00% 1.84s 84.00%
ci-cluster-network-liveness-new-connections 4.16 4.15 amd64 sdn gcp ha 103 0s 0.00% 980ms 716.67%
cache-openshift-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 1s 0.00% 8.34s 178.00%
cache-oauth-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 2s 100.00%
oauth-api-new-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85%
cache-kube-api-new-connections 4.16 amd64 ovn gcp ha 544 1s 0.00% 1.57s 60.20%
service-load-balancer-with-pdb-new-connections 4.16 4.15 heterogeneous ovn azure ha 313 0s 0.00% 880ms 39.68%
host-to-host-new-connections 4.16 4.15 amd64 ovn gcp ha 233 0s 0.00% 680ms 6700.00%
kube-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 4.62s 376.29%
kube-api-new-connections 4.16 amd64 ovn metal ha 702 1s 0.00% 24.99s 38.83%
cache-openshift-api-new-connections 4.16 amd64 ovn gcp ha 544 0s 0.00% 2s 104.08%
oauth-api-reused-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85%
oauth-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 5s 415.46%
kube-api-reused-connections 4.16 amd64 ovn metal ha 702 0s 0.00% 10.99s 83.17%
ingress-to-console-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 37.4s 5743.75%
kube-api-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 2.68s 33.33%
cache-oauth-api-reused-connections 4.16 4.15 amd64 sdn gcp ha 103 0s 0.00% 980ms 716.67%
metrics-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 43s 2116.49%
ingress-to-oauth-server-new-connections 4.16 amd64 sdn vsphere ha 109 0s 0.00% 920ms 338.10%
ci-cluster-network-liveness-new-connections 4.16 4.15 heterogeneous ovn gcp ha 315 0s 0.00% 1s 63.93%
host-to-host-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 9.79s 641.67%
kube-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 3.76s 90.86%
pod-to-service-new-connections 4.16 heterogeneous ovn azure ha 317 0s 0.00% 840ms 33.33%
metrics-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6.5s 0.00% 12.6s 55.75%
openshift-api-new-connections 4.16 4.15 heterogeneous ovn azure ha 316 3s 0.00% 7.7s 54.00%
openshift-api-reused-connections 4.16 amd64 sdn vsphere ha 109 0s 0.00% 2.84s 60.45%
oauth-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 1.61s 91.67%
ingress-to-oauth-server-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 2.68s 34.00%
ingress-to-console-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 4.68s 55.48%
metrics-api-new-connections 4.16 4.15 amd64 sdn metal ha 101 9s 0.00% 29s 30.93%
openshift-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 5s 400.00%
ingress-to-console-new-connections 4.16 amd64 ovn metal compact 129 3s 0.00% 14.44s 46.01%
cache-openshift-api-new-connections 4.16 4.15 heterogeneous ovn azure ha 316 0s 0.00% 2s 222.58%
image-registry-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 39.2s 2962.50%
service-load-balancer-with-pdb-new-connections 4.16 amd64 sdn gcp ha 289 1s 0.00% 3.6s 260.00%
ci-cluster-network-liveness-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 5s 40.45%
cache-kube-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 56.28s 175.07%
cache-kube-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39%
cache-openshift-api-reused-connections 4.17 amd64 ovn azure ha 447 1s 0.00% 2.54s 156.57%
pod-to-service-new-connections 4.17 4.17 amd64 ovn aws single 174 8.35s 0.00% 58.89s 319.44%
kube-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39%
metrics-api-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 42s 66.80%
cache-kube-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 1.74s 74.00%
image-registry-reused-connections 4.17 4.16 amd64 ovn gcp ha 992 1s 0.00% 2s 100.00%
image-registry-new-connections 4.17 4.16 heterogeneous ovn gcp ha 223 1s 0.00% 2.78s 39.00%
ingress-to-oauth-server-new-connections 4.17 4.16 amd64 ovn aws ha 991 1s 0.00% 6s 54.24%
image-registry-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 57.28s 152.89%
metrics-api-reused-connections 4.17 4.16 heterogeneous ovn gcp ha 223 1s 0.00% 5.78s 44.50%
metrics-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 880.08%
host-to-host-new-connections 4.17 heterogeneous ovn gcp ha 225 0s 0.00% 1.76s 76.00%
metrics-api-reused-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 42s 69.42%
kube-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 55.84s 129.79%
host-to-host-new-connections 4.17 4.16 amd64 ovn azure ha 885 0s 0.00% 3.64s 264.00%
kube-api-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 1s 63.93%
cache-oauth-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 2.74s 42.71%
oauth-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39%
gcp-network-liveness-new-connections 4.17 arm64 ovn aws single 146 0s 0.00% 1.55s 118.31%
pod-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 174 8s 0.00% 58.89s 554.33%
ci-cluster-network-liveness-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 3.09s 39.19%
cache-kube-api-new-connections 4.17 4.16 amd64 ovn azure ha 885 0s 0.00% 5s 400.00%
openshift-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 2.74s 50.55%
cache-kube-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 593.22%
kube-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 1.74s 74.00%
image-registry-reused-connections 4.17 amd64 ovn metal ha 179 1s 0.00% 51.16s 4427.43%
metrics-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 122 1s 0.00% 1.79s 79.00%
oauth-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 90.04%
metrics-api-new-connections 4.17 4.16 heterogeneous ovn gcp ha 223 2s 0.00% 5.78s 44.50%
cache-openshift-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.94s 513.95%
cache-openshift-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 58.62s 179.14%
ingress-to-console-reused-connections 4.17 amd64 ovn metal ha 179 1s 0.00% 51.16s 2458.00%
cache-openshift-api-new-connections 4.17 4.17 amd64 ovn azure ha 517 0s 0.00% 2.68s 168.00%
service-load-balancer-with-pdb-new-connections 4.17 arm64 ovn gcp ha 118 0s 0.00% 8.98s 54.83%
cache-openshift-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 1.74s 74.00%
openshift-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 56.62s 138.30%
oauth-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 122 1s 0.00% 2.58s 158.00%
oauth-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 218 5s 0.00% 11.49s 30.72%
kube-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 218 1s 0.00% 3.83s 33.92%
openshift-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 2.74s 50.55%

alerts Information

There were (526) added jobs and (1862) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 62 jobs increased and 620 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
KubeJobFailed openshift-insights Warning 4.16 amd64 ovn aws single 120 1h39m41.6s 49.00% 2h31m5.62s 59.06%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 201 58s 56.76% 2m58s 102.27%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.16 heterogeneous ovn aws ha 199 0s 0.00% 1m28.6s 520.45%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.16 amd64 ovn metal ha 251 0s 0.00% 1m58s 34.09%
NodeSystemSaturation openshift-monitoring Warning 4.16 amd64 ovn aws single 120 3m57.5s 0.00% 8m3.58s 64.76%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 201 0s 0.00% 4m58s 181.45%
etcdGRPCRequestsSlow openshift-etcd Critical 4.17 4.16 amd64 ovn azure ha 211 0s 0.00% 7m55.4s 119.60%
NodeSystemSaturation openshift-monitoring Warning 4.17 amd64 ovn metal ha 201 0s 0.00% 18m56s 60.50%
KubeAggregatedAPIErrors default Warning 4.17 amd64 ovn azure ha 113 0s 0.00% 24m3.12s 172.57%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.17 4.17 amd64 ovn aws single 208 0s 0.00% 2m45.54s 40.91%
etcdHighCommitDurations openshift-etcd Warning 4.17 4.16 amd64 ovn azure ha 211 1m13s 0.00% 20m53.2s 174.58%
KubeJobFailed openshift-insights Warning 4.17 amd64 ovn aws ha 209 1h29m21.6s 0.00% 3h25m21.28s 81.43%
etcdHighCommitDurations openshift-etcd Warning 4.17 amd64 ovn azure ha 113 11.2s 0.00% 41m19.36s 201.52%
/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Aug 02 '24 01:08 openshift-ci-robot

Job Failure Risk Analysis for sha: fb4b31982233adf24eba723cedde49d0bc8c5d0c

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Medium
[sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace
This test has passed 89.92% of 119 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.

openshift-trt-bot avatar Aug 09 '24 04:08 openshift-trt-bot

Don't feel like we want to bring these in. There were changes and a revert that may have impacted these.

openshift-api-http2-service-network-reused-connections 	4.17 		amd64 	ovn 	aws 	ha 	118 	13m42.1s 	822000.00% 	21m50.21s 	159681.71%
kube-api-http2-service-network-reused-connections 	4.17 		amd64 	ovn 	aws 	ha 	118 	10m55.05s 	654950.00% 	14m39.14s 	107112.20%
kube-api-http1-service-network-reused-connections 	4.17 		amd64 	ovn 	aws 	ha 	118 	10m52.5s 	652400.00% 	14m40.97s 	107335.37%
openshift-api-http2-internal-lb-reused-connections 	4.17 		amd64 	ovn 	aws 	ha 	118 	7m45.05s 	1821.69% 	21m52.3s 	5018.17%
kube-api-http2-internal-lb-reused-connections 	4.17 		amd64 	ovn 	aws 	ha 	118 	4m31.45s 	1080.22% 	7m51.23s 	1948.83%

neisw avatar Aug 09 '24 14:08 neisw

Job Failure Risk Analysis for sha: 66748f8c05e70dcffff247d2fe25b88445fcabf0

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Low
[sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace
This test has passed 74.51% of 153 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.
---
[sig-network] pods should successfully create sandboxes by other
This test has passed 74.27% of 4457 runs on release 4.18 [Overall] in the last week.

openshift-trt-bot avatar Aug 23 '24 04:08 openshift-trt-bot

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-openstack-ovn fb77621a26db1973ecdd4edae6f0e1431b1bc24b link false /test e2e-openstack-ovn
ci/prow/e2e-agnostic-ovn-cmd fb77621a26db1973ecdd4edae6f0e1431b1bc24b link false /test e2e-agnostic-ovn-cmd
ci/prow/e2e-aws-ovn-ipsec-serial fb77621a26db1973ecdd4edae6f0e1431b1bc24b link false /test e2e-aws-ovn-ipsec-serial
ci/prow/e2e-aws-ovn-single-node-upgrade fb77621a26db1973ecdd4edae6f0e1431b1bc24b link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-single-node-serial fb77621a26db1973ecdd4edae6f0e1431b1bc24b link false /test e2e-aws-ovn-single-node-serial

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Aug 30 '24 04:08 openshift-ci[bot]

Job Failure Risk Analysis for sha: fb77621a26db1973ecdd4edae6f0e1431b1bc24b

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Low
[sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace
This test has passed 50.67% of 150 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.
---
[sig-network] pods should successfully create sandboxes by adding pod to network
This test has passed 73.33% of 150 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.

Open Bugs
s390x: [sig-network] pods should successfully create sandboxes by adding pod to network fails with error adding pod to CNI network

openshift-trt-bot avatar Aug 30 '24 04:08 openshift-trt-bot

/lgtm

neisw avatar Sep 03 '24 13:09 neisw

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: neisw, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Sep 03 '24 13:09 openshift-ci[bot]

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.18.0-202409032239.p0.g7f451d0.assembly.stream.el9. All builds following this will include this PR.

openshift-bot avatar Sep 04 '24 02:09 openshift-bot