NO-ISSUE: Automated - Update synthetic test data
disruptions Information
There were (2260) added jobs and (276) were removed.
Comparisons were above allowed leeway of 30.00%
Note: For P99, disruptions had 295 jobs increased and 380 jobs decreased.
Click To Show Table
| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase |
|---|---|---|---|---|---|---|---|---|---|---|---|
| kube-api-http2-service-network-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m41.5s | 144.58% | 2m1.77s | 190.62% |
| oauth-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 49s | 4160.87% | 58.97s | 1374.25% |
| openshift-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 47s | 4600.00% | 55s | 1275.00% |
| kube-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 44.85s | 4385.00% | 52s | 1200.00% |
| kube-api-http1-service-network-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m36.1s | 75.05% | 2m35.54s | 182.90% |
| cache-oauth-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 40.85s | 3985.00% | 49s | 914.49% |
| cache-kube-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 39s | 3800.00% | 46.97s | 1074.25% |
| cache-openshift-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 39s | 1850.00% | 45.97s | 819.40% |
| kube-api-http1-service-network-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m5.3s | 129.93% | 1h21m20.71s | 16799.97% |
| openshift-api-http2-internal-lb-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 52.3s | 226.87% | 1h17m57.04s | 29131.50% |
| metrics-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 39s | 1200.00% | 50s | 525.00% |
| kube-api-http1-internal-lb-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m20s | 80.38% | 1h21m20.19s | 10776.29% |
| kube-api-http2-service-network-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m36.55s | 55.98% | 2m23.32s | 128.29% |
| kube-api-http2-service-network-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m3.3s | 118.65% | 1h19m27.09s | 16343.91% |
| kube-api-http1-service-network-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m0.8s | 129.43% | 1m47.94s | 301.26% |
| kube-api-http2-service-network-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 53.15s | 166.42% | 1h30m6.81s | 26947.57% |
| openshift-api-http2-internal-lb-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m18s | 74.11% | 1h23m7.07s | 10992.24% |
| openshift-api-http2-service-network-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 53.15s | 142.69% | 1h1m24.54s | 16663.15% |
| openshift-api-http2-service-network-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m39.7s | 44.91% | 2m45.31s | 136.97% |
| kube-api-http2-internal-lb-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m15.15s | 67.75% | 1h48m44.94s | 14412.77% |
| kube-api-http2-internal-lb-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 50.45s | 143.13% | 1h37m23.28s | 27791.55% |
| kube-api-http1-internal-lb-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 50.45s | 140.24% | 1h16m45.59s | 21831.38% |
| openshift-api-http2-service-network-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 1m1s | 91.52% | 1h29m52.17s | 16766.34% |
| kube-api-http1-service-network-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 138 | 50.15s | 131.11% | 56m4.76s | 15236.19% |
| service-load-balancer-with-pdb-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 22s | 633.33% | 30.94s | 214.75% |
| oauth-api-reused-connections | 4.17 | amd64 | ovn | metal | ha | 257 | 17s | 750.00% | 49.32s | 83.21% | |
| metrics-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 5s | 150.00% | 10.46s | 76.39% |
| ingress-to-console-new-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 3.9s | 168.97% | 14.45s | 49.43% | |
| oauth-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 6s | 53.85% | 14.52s | 51.88% |
| service-load-balancer-with-pdb-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 5s | 66.67% | 12s | 71.43% |
| metrics-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 2.45s | 145.00% | 18s | 800.00% | |
| oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 6.1s | 31.18% | 18.56s | 111.15% |
| kube-api-reused-connections | 4.17 | amd64 | ovn | azure | ha | 422 | 2s | 110.53% | 2s | 102.02% | |
| ingress-to-console-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 2s | 100.00% | 7.97s | 181.63% |
| metrics-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 2s | 100.00% | 10s | 66.67% |
| metrics-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | gcp | ha | 101 | 2s | 100.00% | 6s | 500.00% |
| image-registry-new-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 1.95s | 95.00% | 3.79s | 89.50% |
| kube-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 900.00% | 6.58s | 558.00% |
| oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 900.00% | 2.79s | 39.50% |
| cache-openshift-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 0s | 0.00% | 5.28s | 173.58% |
| cache-oauth-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 2.89s | 44.50% | |
| oauth-api-new-connections | 4.17 | heterogeneous | ovn | aws | ha | 489 | 0s | 0.00% | 1s | 117.39% | |
| ingress-to-console-reused-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 1s | 0.00% | 1m38.18s | 4809.00% | |
| cache-openshift-api-reused-connections | 4.17 | amd64 | ovn | azure | ha | 422 | 1s | 0.00% | 2.79s | 181.82% | |
| openshift-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 950ms | 0.00% | 4.79s | 163.19% |
| image-registry-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 2s | 0.00% | 8.97s | 124.25% |
| openshift-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 2s | 0.00% | 5.28s | 32.00% |
| openshift-api-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 1s | 0.00% | 4s | 33.33% |
| cache-oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 6s | 0.00% | 17.74s | 97.11% |
| oauth-api-new-connections | 4.17 | amd64 | ovn | metal | ha | 257 | 3s | 0.00% | 41s | 41.38% | |
| metrics-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 1s | 0.00% | 7.16s | 79.00% |
| cache-openshift-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | gcp | ha | 101 | 1s | 0.00% | 2s | 122.22% |
| pod-to-service-new-connections | 4.17 | 4.17 | amd64 | ovn | aws | single | 586 | 6s | 0.00% | 55.3s | 293.87% |
| cache-kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 0s | 0.00% | 5.69s | 469.00% |
| oauth-api-reused-connections | 4.17 | arm64 | ovn | aws | ha | 573 | 0s | 0.00% | 1.56s | 56.00% | |
| ingress-to-console-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 1s | 0.00% | 1.79s | 79.00% |
| ingress-to-oauth-server-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 1s | 0.00% | 8s | 166.67% |
| host-to-service-reused-connections | 4.17 | 4.17 | amd64 | ovn | aws | single | 586 | 0s | 0.00% | 45.3s | 784.77% |
| openshift-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 2.89s | 44.50% | |
| oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 0s | 0.00% | 4s | 300.00% |
| cache-oauth-api-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 1s | 0.00% | 5s | 66.67% |
| host-to-service-new-connections | 4.17 | 4.17 | amd64 | ovn | aws | single | 586 | 750ms | 0.00% | 45.45s | 717.45% |
| service-load-balancer-with-pdb-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 1s | 0.00% | 8s | 337.16% |
| ingress-to-console-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 0.00% | 5s | 66.67% |
| image-registry-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 1s | 0.00% | 1.79s | 79.00% |
| image-registry-reused-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 1s | 0.00% | 2s | 100.00% |
| kube-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | gcp | ha | 101 | 0s | 0.00% | 2s | 100.00% |
| cache-kube-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 2.89s | 44.50% | |
| openshift-api-new-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 0s | 0.00% | 1m49.96s | 362.79% | |
| image-registry-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 0.00% | 4s | 33.33% |
| openshift-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 0s | 0.00% | 6.84s | 242.00% |
| kube-api-new-connections | 4.17 | arm64 | ovn | aws | ha | 573 | 0s | 0.00% | 1s | 63.93% | |
| openshift-api-new-connections | 4.17 | heterogeneous | ovn | azure | ha | 193 | 400ms | 0.00% | 4s | 100.00% | |
| cache-openshift-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 200ms | 0.00% | 5.36s | 587.18% |
| openshift-api-http2-internal-lb-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 1m3.7s | 0.00% | 1m49.08s | 102.60% |
| kube-api-http2-internal-lb-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 124 | 59.7s | 0.00% | 1m52.77s | 98.61% |
| metrics-api-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 2.45s | 0.00% | 8.38s | 39.67% |
| kube-api-new-connections | 4.17 | heterogeneous | ovn | aws | ha | 489 | 0s | 0.00% | 1s | 117.39% | |
| ingress-to-oauth-server-new-connections | 4.17 | 4.17 | amd64 | ovn | aws | ha | 713 | 1s | 0.00% | 4.88s | 68.86% |
| ingress-to-oauth-server-new-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 0.00% | 4.79s | 59.67% |
| ingress-to-oauth-server-reused-connections | 4.17 | amd64 | ovn | aws | single | 429 | 7s | 0.00% | 11.72s | 46.50% | |
| cache-openshift-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 3s | 50.00% | |
| cache-openshift-api-new-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 0s | 0.00% | 1m47.62s | 412.48% | |
| ingress-to-console-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 0s | 0.00% | 2.64s | 183.87% |
| ingress-to-console-new-connections | 4.17 | amd64 | ovn | aws | external | 745 | 0s | 0.00% | 16s | 60.00% | |
| image-registry-new-connections | 4.17 | heterogeneous | ovn | azure | ha | 193 | 0s | 0.00% | 2s | 112.77% | |
| kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 1s | 0.00% | 5s | 66.67% |
| ingress-to-console-reused-connections | 4.17 | amd64 | ovn | aws | external | 745 | 0s | 0.00% | 12.24s | 36.00% | |
| cache-oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 0s | 0.00% | 2.79s | 50.00% |
| oauth-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | gcp | ha | 101 | 1s | 0.00% | 3s | 200.00% |
| metrics-api-new-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 18.78s | 49.40% | |
| oauth-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 14s | 0.00% | 24.97s | 2397.00% |
| kube-api-new-connections | 4.17 | heterogeneous | ovn | azure | ha | 193 | 1s | 0.00% | 2.08s | 108.00% | |
| host-to-service-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 0s | 0.00% | 4.36s | 336.00% |
| kube-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 222 | 1s | 0.00% | 2s | 100.00% |
| image-registry-reused-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 1s | 0.00% | 1m40.04s | 8753.10% | |
| cache-openshift-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 2s | 0.00% | 3s | 200.00% |
| service-load-balancer-with-pdb-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 1s | 0.00% | 2.68s | 50.56% |
| openshift-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 1s | 0.00% | 5.82s | 98.63% |
| kube-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 219 | 1s | 0.00% | 6s | 109.79% |
| pod-to-service-reused-connections | 4.17 | 4.17 | amd64 | ovn | aws | single | 586 | 5.75s | 0.00% | 55.3s | 514.44% |
| kube-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 11s | 0.00% | 14s | 1300.00% |
| metrics-api-reused-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 0s | 0.00% | 1m41.9s | 1852.11% | |
| cache-oauth-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 2s | 0.00% | 11.97s | 1097.00% |
| cache-kube-api-reused-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 0s | 0.00% | 1m38.8s | 1238.75% | |
| kube-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 2.89s | 44.50% | |
| oauth-api-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 846 | 1s | 0.00% | 5s | 66.67% |
| openshift-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 14s | 0.00% | 18s | 1700.00% |
| ingress-to-console-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 1s | 0.00% | 4.97s | 397.00% |
| cache-kube-api-reused-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 1004 | 2s | 0.00% | 3s | 200.00% |
| ingress-to-oauth-server-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 0s | 0.00% | 8.69s | 769.00% |
| oauth-api-reused-connections | 4.17 | amd64 | ovn | metal | compact | 112 | 1s | 0.00% | 2.89s | 44.50% | |
| ingress-to-console-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 932 | 0s | 0.00% | 8s | 700.00% |
| metrics-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 222 | 2s | 0.00% | 6.79s | 69.75% |
| kube-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 117 | 1s | 0.00% | 5.36s | 436.00% |
| metrics-api-new-connections | 4.17 | amd64 | ovn | metal | ha | 163 | 0s | 0.00% | 1m50.96s | 418.99% | |
| ingress-to-console-new-connections | 4.17 | amd64 | ovn | aws | single | 429 | 0s | 0.00% | 2s | 100.00% |
alerts Information
There were (9162) added jobs and (5778) were removed.
Comparisons were above allowed leeway of 30.00%
Note: For P99, alerts had 40 jobs increased and 273 jobs decreased.
Click To Show Table
| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase |
|---|---|---|---|---|---|---|---|---|---|---|---|
| CannotRetrieveUpdates openshift-cluster-version Warning | 4.17 | ppc64le | ovn | libvirt | ha | 120 | 33m10.8s | 120.10% | 45m50.48s | 100.44% | |
| AlertmanagerReceiversNotConfigured openshift-monitoring Warning | 4.17 | ppc64le | ovn | libvirt | ha | 120 | 1h6m10.7s | 32.22% | 1h18m37.8s | 34.81% | |
| HighOverallControlPlaneCPU openshift-kube-apiserver Warning | 4.17 | amd64 | ovn | metal | ha | 155 | 1m11.4s | 92.97% | 10m23.6s | 608.64% | |
| KubeJobFailed openshift-insights Warning | 4.17 | amd64 | ovn | aws | ha | 154 | 0s | 0.00% | 3h16m13.64s | 73.37% | |
| CoreDNSErrorsHigh openshift-dns Warning | 4.17 | ppc64le | ovn | libvirt | ha | 120 | 0s | 0.00% | 1m58s | 114.16% | |
| AlertmanagerReceiversNotConfigured openshift-monitoring Warning | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 254 | 1h52m4.7s | 0.00% | 2h33m14.94s | 36.97% |
| etcdHighCommitDurations openshift-etcd Warning | 4.17 | 4.16 | amd64 | ovn | azure | ha | 231 | 29s | 0.00% | 28m43.8s | 277.70% |
| ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning | 4.17 | amd64 | ovn | metal | ha | 155 | 0s | 0.00% | 4m33.52s | 158.33% | |
| NodeSystemSaturation openshift-monitoring Warning | 4.17 | amd64 | ovn | metal | ha | 155 | 8.4s | 0.00% | 20m46.96s | 76.17% |
@openshift-bot: This pull request explicitly references no jira issue.
In response to this:
disruptions Information
There were (
0) added jobs and (252) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, disruptions had
229jobs increased and868jobs decreased.Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase host-to-service-new-connections 4.17 4.17 amd64 ovn aws single 174 4.35s 335.00% 49.89s 797.30% host-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 174 4s 400.00% 49.16s 860.16% ingress-to-console-new-connections 4.16 4.15 amd64 sdn metal ha 101 8s 60.00% 23s 34.90% cache-openshift-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 252.94% 8.62s 788.66% cache-oauth-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 200.00% 8.62s 762.00% kube-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 200.00% 11.24s 1024.00% oauth-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 76.47% 11.24s 479.38% cache-kube-api-new-connections 4.16 amd64 ovn vsphere ha 639 3s 62.16% 8.62s 337.56% kube-api-reused-connections 4.17 amd64 ovn azure ha 447 2s 110.53% 3s 203.03% service-load-balancer-with-pdb-new-connections 4.16 4.15 amd64 sdn gcp ha 103 2s 100.00% 2.98s 40.57% openshift-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 4s 33.33% 7.67s 86.17% openshift-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 3s 50.00% 14.2s 87.83% kube-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 4s 33.33% 7.89s 91.50% kube-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 1s 900.00% 4.22s 322.00% oauth-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 1s 900.00% 2.74s 37.00% kube-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 3s 36.36% 7.4s 85.00% ingress-to-console-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 1.7s 70.00% 4s 33.33% image-registry-new-connections 4.16 4.15 heterogeneous ovn aws ha 328 1s 0.00% 2s 30.72% kube-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6s 0.00% 11.6s 38.76% oauth-api-new-connections 4.16 amd64 ovn gcp ha 544 1s 0.00% 2s 104.08% cache-kube-api-new-connections 4.16 arm64 ovn azure ha 154 0s 0.00% 1s 38.89% ingress-to-oauth-server-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 30.4s 1753.66% cache-oauth-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 9.28s 212.46% cache-openshift-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 11.8s 201.02% cache-oauth-api-new-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85% pod-to-pod-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67% openshift-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6s 0.00% 11.6s 38.76% azure-network-liveness-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67% ingress-to-console-reused-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 1s 56.25% host-to-service-new-connections 4.16 heterogeneous ovn azure ha 317 0s 0.00% 840ms 33.33% cache-kube-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 6.67s 390.44% ingress-to-oauth-server-new-connections 4.16 4.15 amd64 sdn metal ha 101 1s 0.00% 2s 73.91% image-registry-new-connections 4.16 arm64 ovn aws ha 652 1s 0.00% 3.49s 36.86% oauth-api-reused-connections 4.16 amd64 ovn azure ha 525 2.8s 0.00% 10s 236.70% cache-kube-api-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 3.4s 165.62% host-to-service-new-connections 4.16 amd64 sdn vsphere ha 109 2s 0.00% 2.92s 41.06% metrics-api-reused-connections 4.16 4.15 amd64 sdn azure ha 112 5.45s 0.00% 12.56s 32.49% openshift-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 1.61s 61.00% pod-to-host-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 14.24s 641.67% openshift-api-new-connections 4.16 amd64 ovn metal ha 207 0s 0.00% 940ms 347.62% openshift-api-new-connections 4.16 arm64 ovn azure ha 154 0s 0.00% 1s 38.89% pod-to-host-reused-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67% host-to-host-reused-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 890ms 641.67% cache-oauth-api-reused-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85% host-to-service-reused-connections 4.16 4.15 amd64 sdn aws ha 191 0s 0.00% 2s 545.16% kube-api-new-connections 4.16 amd64 sdn azure ha 117 200ms 0.00% 1.84s 84.00% ci-cluster-network-liveness-new-connections 4.16 4.15 amd64 sdn gcp ha 103 0s 0.00% 980ms 716.67% cache-openshift-api-new-connections 4.16 4.15 amd64 sdn azure ha 112 1s 0.00% 8.34s 178.00% cache-oauth-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 2s 100.00% oauth-api-new-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85% cache-kube-api-new-connections 4.16 amd64 ovn gcp ha 544 1s 0.00% 1.57s 60.20% service-load-balancer-with-pdb-new-connections 4.16 4.15 heterogeneous ovn azure ha 313 0s 0.00% 880ms 39.68% host-to-host-new-connections 4.16 4.15 amd64 ovn gcp ha 233 0s 0.00% 680ms 6700.00% kube-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 4.62s 376.29% kube-api-new-connections 4.16 amd64 ovn metal ha 702 1s 0.00% 24.99s 38.83% cache-openshift-api-new-connections 4.16 amd64 ovn gcp ha 544 0s 0.00% 2s 104.08% oauth-api-reused-connections 4.16 arm64 ovn aws single 156 3s 0.00% 26.6s 124.85% oauth-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 5s 415.46% kube-api-reused-connections 4.16 amd64 ovn metal ha 702 0s 0.00% 10.99s 83.17% ingress-to-console-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 37.4s 5743.75% kube-api-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 2.68s 33.33% cache-oauth-api-reused-connections 4.16 4.15 amd64 sdn gcp ha 103 0s 0.00% 980ms 716.67% metrics-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 43s 2116.49% ingress-to-oauth-server-new-connections 4.16 amd64 sdn vsphere ha 109 0s 0.00% 920ms 338.10% ci-cluster-network-liveness-new-connections 4.16 4.15 heterogeneous ovn gcp ha 315 0s 0.00% 1s 63.93% host-to-host-new-connections 4.16 4.15 amd64 sdn azure ha 112 0s 0.00% 9.79s 641.67% kube-api-reused-connections 4.16 amd64 ovn azure ha 525 2s 0.00% 3.76s 90.86% pod-to-service-new-connections 4.16 heterogeneous ovn azure ha 317 0s 0.00% 840ms 33.33% metrics-api-new-connections 4.16 4.15 amd64 ovn vsphere ha 111 6.5s 0.00% 12.6s 55.75% openshift-api-new-connections 4.16 4.15 heterogeneous ovn azure ha 316 3s 0.00% 7.7s 54.00% openshift-api-reused-connections 4.16 amd64 sdn vsphere ha 109 0s 0.00% 2.84s 60.45% oauth-api-reused-connections 4.16 arm64 ovn gcp ha 140 0s 0.00% 1.61s 91.67% ingress-to-oauth-server-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 2.68s 34.00% ingress-to-console-new-connections 4.16 4.15 amd64 ovn gcp ha 233 1s 0.00% 4.68s 55.48% metrics-api-new-connections 4.16 4.15 amd64 sdn metal ha 101 9s 0.00% 29s 30.93% openshift-api-reused-connections 4.16 amd64 ovn vsphere ha 639 1s 0.00% 5s 400.00% ingress-to-console-new-connections 4.16 amd64 ovn metal compact 129 3s 0.00% 14.44s 46.01% cache-openshift-api-new-connections 4.16 4.15 heterogeneous ovn azure ha 316 0s 0.00% 2s 222.58% image-registry-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 39.2s 2962.50% service-load-balancer-with-pdb-new-connections 4.16 amd64 sdn gcp ha 289 1s 0.00% 3.6s 260.00% ci-cluster-network-liveness-new-connections 4.16 4.15 arm64 ovn azure ha 161 0s 0.00% 5s 40.45% cache-kube-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 56.28s 175.07% cache-kube-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39% cache-openshift-api-reused-connections 4.17 amd64 ovn azure ha 447 1s 0.00% 2.54s 156.57% pod-to-service-new-connections 4.17 4.17 amd64 ovn aws single 174 8.35s 0.00% 58.89s 319.44% kube-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39% metrics-api-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 42s 66.80% cache-kube-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 1.74s 74.00% image-registry-reused-connections 4.17 4.16 amd64 ovn gcp ha 992 1s 0.00% 2s 100.00% image-registry-new-connections 4.17 4.16 heterogeneous ovn gcp ha 223 1s 0.00% 2.78s 39.00% ingress-to-oauth-server-new-connections 4.17 4.16 amd64 ovn aws ha 991 1s 0.00% 6s 54.24% image-registry-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 57.28s 152.89% metrics-api-reused-connections 4.17 4.16 heterogeneous ovn gcp ha 223 1s 0.00% 5.78s 44.50% metrics-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 880.08% host-to-host-new-connections 4.17 heterogeneous ovn gcp ha 225 0s 0.00% 1.76s 76.00% metrics-api-reused-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 42s 69.42% kube-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 55.84s 129.79% host-to-host-new-connections 4.17 4.16 amd64 ovn azure ha 885 0s 0.00% 3.64s 264.00% kube-api-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 1s 63.93% cache-oauth-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 2.74s 42.71% oauth-api-new-connections 4.17 heterogeneous ovn aws ha 476 0s 0.00% 1s 117.39% gcp-network-liveness-new-connections 4.17 arm64 ovn aws single 146 0s 0.00% 1.55s 118.31% pod-to-service-reused-connections 4.17 4.17 amd64 ovn aws single 174 8s 0.00% 58.89s 554.33% ci-cluster-network-liveness-new-connections 4.17 arm64 ovn aws ha 592 0s 0.00% 3.09s 39.19% cache-kube-api-new-connections 4.17 4.16 amd64 ovn azure ha 885 0s 0.00% 5s 400.00% openshift-api-new-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 2.74s 50.55% cache-kube-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 593.22% kube-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 1.74s 74.00% image-registry-reused-connections 4.17 amd64 ovn metal ha 179 1s 0.00% 51.16s 4427.43% metrics-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 122 1s 0.00% 1.79s 79.00% oauth-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.16s 90.04% metrics-api-new-connections 4.17 4.16 heterogeneous ovn gcp ha 223 2s 0.00% 5.78s 44.50% cache-openshift-api-reused-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 51.94s 513.95% cache-openshift-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 58.62s 179.14% ingress-to-console-reused-connections 4.17 amd64 ovn metal ha 179 1s 0.00% 51.16s 2458.00% cache-openshift-api-new-connections 4.17 4.17 amd64 ovn azure ha 517 0s 0.00% 2.68s 168.00% service-load-balancer-with-pdb-new-connections 4.17 arm64 ovn gcp ha 118 0s 0.00% 8.98s 54.83% cache-openshift-api-new-connections 4.17 heterogeneous ovn gcp ha 227 0s 0.00% 1.74s 74.00% openshift-api-new-connections 4.17 amd64 ovn metal ha 179 0s 0.00% 56.62s 138.30% oauth-api-reused-connections 4.17 4.16 arm64 ovn gcp ha 122 1s 0.00% 2.58s 158.00% oauth-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 218 5s 0.00% 11.49s 30.72% kube-api-new-connections 4.17 4.16 heterogeneous ovn azure ha 218 1s 0.00% 3.83s 33.92% openshift-api-reused-connections 4.17 4.16 heterogeneous ovn aws ha 227 0s 0.00% 2.74s 50.55% alerts Information
There were (
526) added jobs and (1862) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, alerts had
62jobs increased and620jobs decreased./cc @dgoodwin, @neisw, @DennisPeriquetClick To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase KubeJobFailed openshift-insights Warning 4.16 amd64 ovn aws single 120 1h39m41.6s 49.00% 2h31m5.62s 59.06% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 201 58s 56.76% 2m58s 102.27% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.16 heterogeneous ovn aws ha 199 0s 0.00% 1m28.6s 520.45% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.16 amd64 ovn metal ha 251 0s 0.00% 1m58s 34.09% NodeSystemSaturation openshift-monitoring Warning 4.16 amd64 ovn aws single 120 3m57.5s 0.00% 8m3.58s 64.76% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.17 amd64 ovn metal ha 201 0s 0.00% 4m58s 181.45% etcdGRPCRequestsSlow openshift-etcd Critical 4.17 4.16 amd64 ovn azure ha 211 0s 0.00% 7m55.4s 119.60% NodeSystemSaturation openshift-monitoring Warning 4.17 amd64 ovn metal ha 201 0s 0.00% 18m56s 60.50% KubeAggregatedAPIErrors default Warning 4.17 amd64 ovn azure ha 113 0s 0.00% 24m3.12s 172.57% CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.17 4.17 amd64 ovn aws single 208 0s 0.00% 2m45.54s 40.91% etcdHighCommitDurations openshift-etcd Warning 4.17 4.16 amd64 ovn azure ha 211 1m13s 0.00% 20m53.2s 174.58% KubeJobFailed openshift-insights Warning 4.17 amd64 ovn aws ha 209 1h29m21.6s 0.00% 3h25m21.28s 81.43% etcdHighCommitDurations openshift-etcd Warning 4.17 amd64 ovn azure ha 113 11.2s 0.00% 41m19.36s 201.52%
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.
Job Failure Risk Analysis for sha: fb4b31982233adf24eba723cedde49d0bc8c5d0c
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade | Medium [sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace This test has passed 89.92% of 119 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week. |
Don't feel like we want to bring these in. There were changes and a revert that may have impacted these.
openshift-api-http2-service-network-reused-connections 4.17 amd64 ovn aws ha 118 13m42.1s 822000.00% 21m50.21s 159681.71%
kube-api-http2-service-network-reused-connections 4.17 amd64 ovn aws ha 118 10m55.05s 654950.00% 14m39.14s 107112.20%
kube-api-http1-service-network-reused-connections 4.17 amd64 ovn aws ha 118 10m52.5s 652400.00% 14m40.97s 107335.37%
openshift-api-http2-internal-lb-reused-connections 4.17 amd64 ovn aws ha 118 7m45.05s 1821.69% 21m52.3s 5018.17%
kube-api-http2-internal-lb-reused-connections 4.17 amd64 ovn aws ha 118 4m31.45s 1080.22% 7m51.23s 1948.83%
Job Failure Risk Analysis for sha: 66748f8c05e70dcffff247d2fe25b88445fcabf0
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade | Low [sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace This test has passed 74.51% of 153 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week. --- [sig-network] pods should successfully create sandboxes by other This test has passed 74.27% of 4457 runs on release 4.18 [Overall] in the last week. |
@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:
| Test name | Commit | Details | Required | Rerun command |
|---|---|---|---|---|
| ci/prow/e2e-openstack-ovn | fb77621a26db1973ecdd4edae6f0e1431b1bc24b | link | false | /test e2e-openstack-ovn |
| ci/prow/e2e-agnostic-ovn-cmd | fb77621a26db1973ecdd4edae6f0e1431b1bc24b | link | false | /test e2e-agnostic-ovn-cmd |
| ci/prow/e2e-aws-ovn-ipsec-serial | fb77621a26db1973ecdd4edae6f0e1431b1bc24b | link | false | /test e2e-aws-ovn-ipsec-serial |
| ci/prow/e2e-aws-ovn-single-node-upgrade | fb77621a26db1973ecdd4edae6f0e1431b1bc24b | link | false | /test e2e-aws-ovn-single-node-upgrade |
| ci/prow/e2e-aws-ovn-single-node-serial | fb77621a26db1973ecdd4edae6f0e1431b1bc24b | link | false | /test e2e-aws-ovn-single-node-serial |
Full PR test history. Your PR dashboard.
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.
Job Failure Risk Analysis for sha: fb77621a26db1973ecdd4edae6f0e1431b1bc24b
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade | Low [sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace This test has passed 50.67% of 150 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week. --- [sig-network] pods should successfully create sandboxes by adding pod to network This test has passed 73.33% of 150 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week. Open Bugs s390x: [sig-network] pods should successfully create sandboxes by adding pod to network fails with error adding pod to CNI network |
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: neisw, openshift-bot
The full list of commands accepted by this bot can be found here.
The pull request process is described here
- ~~OWNERS~~ [neisw]
Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment
[ART PR BUILD NOTIFIER]
Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.18.0-202409032239.p0.g7f451d0.assembly.stream.el9. All builds following this will include this PR.