origin
origin copied to clipboard
NO-ISSUE: Automated - Update synthetic test data
disruptions Information
There were (1248) added jobs and (448) were removed.
Comparisons were above allowed leeway of 30.00%
Note: For P99, disruptions had 725 jobs increased and 1662 jobs decreased.
Click To Show Table
| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase |
|---|---|---|---|---|---|---|---|---|---|---|---|
| pod-to-host-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 57m52.7s | 83.30% | 1h27m34.84s | 70.77% | |
| host-to-host-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 55m39.1s | 71.81% | 1h28m50.66s | 52.02% | |
| pod-to-host-reused-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 25m37.4s | 60.40% | 49m13.14s | 41.86% | |
| kube-api-http1-localhost-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 28m34.7s | 40.43% | 36m5.7s | 32.45% | |
| image-registry-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 8m8.6s | 48760.00% | 31m9.64s | 93382.00% |
| image-registry-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 8m8s | 16727.59% | 31m10s | 37300.00% |
| kube-api-http2-service-network-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 13m12.5s | 151.99% | 23m39.74s | 40.61% | |
| openshift-api-http2-service-network-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 12m27.6s | 152.57% | 23m45.66s | 34.70% | |
| kube-api-http1-service-network-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 12m41.2s | 143.97% | 24m55.86s | 48.63% | |
| azure-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | azure | ha | 537 | 7m20.2s | 43920.00% | 9m26.56s | 6982.00% |
| kube-api-http2-internal-lb-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 10m34s | 111.69% | 19m58.08s | 77.60% | |
| kube-api-http1-internal-lb-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 10m42.5s | 103.97% | 19m25.98s | 72.94% | |
| gcp-network-liveness-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 5m31.35s | 6461.39% | 8m51.32s | 55.89% |
| openshift-api-http2-internal-lb-new-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 10m30.7s | 104.11% | 19m25.02s | 65.89% | |
| azure-network-liveness-new-connections | 4.19 | amd64 | ovn | gcp | ha | 370 | 5m28.3s | 2387.12% | 13m40.31s | 336.29% | |
| azure-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 4m19.4s | 2831.07% | 9m22.27s | 108.63% |
| azure-network-liveness-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 4m1.4s | 3923.33% | 10m3.74s | 218.56% |
| azure-network-liveness-new-connections | 4.20 | 4.20 | arm64 | ovn | aws | ha | 162 | 4m1.4s | 2441.05% | 11m30.22s | 34.01% |
| azure-network-liveness-new-connections | 4.20 | 4.19 | amd64 | ovn | aws | ha | 1107 | 3m44.9s | 3135.97% | 9m58.78s | 1591.95% |
| gcp-network-liveness-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 3m43s | 4272.55% | 9m25.35s | 402.44% | |
| azure-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | ha | 823 | 3m33s | 9366.67% | 12m49.68s | 82.93% | |
| azure-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 3m24.2s | 1942.00% | 10m40.92s | 55.25% |
| azure-network-liveness-new-connections | 4.19 | 4.18 | amd64 | ovn | aws | ha | 970 | 3m22.2s | 1922.00% | 12m29.28s | 135.92% |
| azure-network-liveness-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 6m8.35s | 83.81% | 16m59.01s | 160.24% |
| gcp-network-liveness-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 2m47.7s | 8285.00% | 6m55.1s | 236.22% |
| gcp-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 2m50.4s | 2740.00% | 6m30.48s | 137.60% |
| openshift-api-http2-localhost-new-connections | 4.19 | amd64 | ovn | azure | ha | 315 | 4m1.3s | 209.36% | 4m23.86s | 203.57% | |
| gcp-network-liveness-new-connections | 4.20 | 4.20 | arm64 | ovn | aws | ha | 162 | 2m47.2s | 2085.62% | 8m48.02s | 71.16% |
| gcp-network-liveness-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 4m19.55s | 156.35% | 11m20.51s | 219.35% |
| gcp-network-liveness-new-connections | 4.20 | 4.19 | amd64 | ovn | aws | ha | 1107 | 2m36.8s | 7740.00% | 7m11.67s | 1423.18% |
| openshift-api-http2-localhost-new-connections | 4.19 | amd64 | ovn | vsphere | ha | 445 | 3m55.4s | 190.62% | 4m21.56s | 218.98% | |
| kube-api-http1-localhost-new-connections | 4.19 | amd64 | ovn | azure | ha | 315 | 3m25.3s | 215.85% | 3m40.72s | 194.61% | |
| kube-api-http2-localhost-reused-connections | 4.19 | amd64 | ovn | azure | ha | 315 | 3m25.3s | 215.85% | 3m40.72s | 194.61% | |
| kube-api-http1-localhost-reused-connections | 4.19 | amd64 | ovn | azure | ha | 315 | 3m24.6s | 214.77% | 3m39.86s | 193.46% | |
| gcp-network-liveness-new-connections | 4.19 | 4.18 | amd64 | ovn | azure | ha | 830 | 2m21.2s | 4114.93% | 6m41.98s | 30.36% |
| gcp-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 2m19.6s | 4713.79% | 7m33.84s | 107.75% |
| kube-api-http1-localhost-new-connections | 4.19 | amd64 | ovn | vsphere | ha | 445 | 3m20.8s | 186.86% | 3m49.36s | 218.56% | |
| azure-network-liveness-new-connections | 4.20 | amd64 | ovn | aws | external | 679 | 2m7.1s | 10491.67% | 15m7.6s | 1533.55% | |
| gcp-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | ha | 823 | 2m3.2s | 12220.00% | 8m52.34s | 289.99% | |
| gcp-network-liveness-new-connections | 4.20 | amd64 | ovn | aws | external | 679 | 1m25.1s | 5218.75% | 10m1.08s | 887.32% | |
| cache-kube-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 16.2s | 1520.00% | 29m58s | 59833.33% |
| oauth-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 16.2s | 1520.00% | 30m27.92s | 45598.00% |
| metrics-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 16s | 1500.00% | 29m58.36s | 44859.00% |
| cache-openshift-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 15.2s | 1420.00% | 29m57.36s | 44834.00% |
| openshift-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 15.2s | 1420.00% | 30m27.92s | 45598.00% |
| cache-oauth-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 15.2s | 1420.00% | 29m59s | 59866.67% |
| kube-api-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 15.2s | 1420.00% | 30m27.92s | 60830.67% |
| azure-network-liveness-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 10.95s | 508.33% | 5m48.86s | 4154.39% | |
| ingress-to-console-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 8s | 300.00% | 30m27.56s | 36451.20% |
| ingress-to-oauth-server-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 7s | 250.00% | 30m30s | 36500.00% |
| gcp-network-liveness-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 6.1s | 408.33% | 3m34.28s | 1891.45% | |
| ingress-to-console-new-connections | 4.19 | 4.19 | arm64 | ovn | aws | ha | 179 | 2s | 100.00% | 5.54s | 84.67% |
| ingress-to-console-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 2s | 100.00% | 30m26.92s | 182592.00% |
| service-load-balancer-with-pdb-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 4s | 33.33% | 17m24.56s | 34718.67% |
| service-load-balancer-with-pdb-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 2s | 100.00% | 17m27.08s | 26208.54% |
| ingress-to-oauth-server-new-connections | 4.20 | 4.20 | arm64 | ovn | aws | ha | 162 | 2s | 100.00% | 4.39s | 38.49% |
| image-registry-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 2s | 100.00% | 31m5.7s | 93185.00% |
| image-registry-new-connections | 4.20 | 4.20 | arm64 | ovn | aws | ha | 162 | 1.95s | 95.00% | 5.17s | 54.79% |
| service-load-balancer-with-pdb-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1.7s | 70.00% | 28m45.24s | 86162.00% |
| openshift-api-http2-localhost-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m12.45s | 0.00% | 1m38.05s | 40.09% |
| oauth-api-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 750ms | 0.00% | 5.05s | 67.22% | |
| ingress-to-oauth-server-new-connections | 4.19 | 4.18 | amd64 | ovn | azure | ha | 830 | 0s | 0.00% | 2s | 100.00% |
| cache-kube-api-reused-connections | 4.19 | amd64 | ovn | azure | ha | 318 | 1s | 0.00% | 2s | 100.00% | |
| cache-kube-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 4.85s | 304.17% | |
| ci-cluster-network-liveness-new-connections | 4.19 | amd64 | ovn | gcp | ha | 370 | 0s | 0.00% | 23.55s | 47.19% | |
| oauth-api-new-connections | 4.19 | 4.18 | amd64 | ovn | aws | ha | 970 | 0s | 0.00% | 13s | 333.33% |
| host-to-service-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 50ms | 0.00% | 1m1.69s | 6069.00% |
| host-to-service-new-connections | 4.19 | amd64 | ovn | azure | ha | 179 | 0s | 0.00% | 1.66s | 66.00% | |
| pod-to-pod-reused-connections | 4.19 | amd64 | ovn | vsphere | ha | 600 | 0s | 0.00% | 41.02s | 5597.22% | |
| cache-oauth-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 1s | 0.00% | 9.58s | 219.33% |
| host-to-host-new-connections | 4.19 | 4.18 | amd64 | ovn | azure | ha | 830 | 0s | 0.00% | 7.42s | 642.00% |
| image-registry-new-connections | 4.19 | amd64 | ovn | aws | ha | 216 | 1s | 0.00% | 19.85s | 1885.00% | |
| image-registry-reused-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 1s | 0.00% | 31m9.24s | 186824.00% |
| ci-cluster-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 11s | 450.00% |
| image-registry-reused-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 1.87s | 59.83% |
| oauth-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 30m27.28s | 182628.00% |
| azure-network-liveness-new-connections | 4.19 | heterogeneous | ovn | aws | ha | 548 | 1m5.2s | 0.00% | 5m23.84s | 7396.30% | |
| pod-to-host-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 0s | 0.00% | 5.7s | 1681.25% | |
| kube-api-new-connections | 4.19 | 4.18 | amd64 | ovn | aws | ha | 970 | 0s | 0.00% | 8.3s | 80.43% |
| oauth-api-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 7s | 422.39% |
| kube-api-http1-localhost-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m8.4s | 0.00% | 1m33.04s | 39.36% |
| kube-api-http2-internal-lb-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 4s | 0.00% | 6s | 500.00% |
| kube-api-http2-localhost-reused-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m8.4s | 0.00% | 1m33.04s | 39.36% |
| ci-cluster-network-liveness-new-connections | 4.19 | amd64 | ovn | metal | compact | 119 | 100ms | 0.00% | 10.28s | 678.79% | |
| oauth-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 0s | 0.00% | 8.58s | 256.02% |
| oauth-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 9.7s | 708.33% | |
| kube-api-http2-service-network-reused-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 0s | 0.00% | 1.02s | 343.48% |
| azure-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | external | 869 | 7.2s | 0.00% | 5m23s | 49.87% | |
| host-to-service-new-connections | 4.19 | amd64 | ovn | vsphere | ha | 599 | 0s | 0.00% | 6.02s | 385.48% | |
| cache-openshift-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 2.91s | 142.50% | |
| gcp-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | single | 486 | 5m7.75s | 0.00% | 7m36.75s | 8855.88% |
| host-to-service-new-connections | 4.19 | heterogeneous | ovn | aws | ha | 548 | 0s | 0.00% | 1s | 203.03% | |
| cache-kube-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 0s | 0.00% | 10.58s | 252.67% |
| metrics-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 450ms | 0.00% | 5.58s | 86.00% |
| kube-api-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 7s | 600.00% |
| openshift-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 9.7s | 708.33% | |
| oauth-api-reused-connections | 4.19 | amd64 | ovn | vsphere | ha | 601 | 0s | 0.00% | 6s | 867.74% | |
| azure-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | single | 486 | 7m32.5s | 0.00% | 10m53.7s | 7775.90% |
| cache-openshift-api-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 0s | 0.00% | 5.05s | 152.50% | |
| service-load-balancer-with-pdb-new-connections | 4.19 | 4.18 | amd64 | ovn | azure | ha | 830 | 0s | 0.00% | 2s | 100.00% |
| cache-oauth-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 5.82s | 385.00% | |
| openshift-api-new-connections | 4.19 | 4.18 | amd64 | ovn | aws | ha | 970 | 0s | 0.00% | 8.3s | 130.56% |
| gcp-network-liveness-new-connections | 4.19 | heterogeneous | ovn | aws | ha | 548 | 45s | 0.00% | 2m55.53s | 5171.17% | |
| cache-openshift-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 450ms | 0.00% | 5.87s | 143.57% |
| kube-api-http2-localhost-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m8.4s | 0.00% | 1m33.04s | 39.36% |
| pod-to-host-reused-connections | 4.19 | amd64 | ovn | metal | ha | 223 | 0s | 0.00% | 2m9.14s | 6357.00% | |
| kube-api-http2-service-network-reused-connections | 4.19 | amd64 | ovn | azure | ha | 315 | 0s | 0.00% | 13.02s | 1256.25% | |
| ingress-to-console-new-connections | 4.19 | amd64 | ovn | aws | ha | 216 | 1s | 0.00% | 2s | 100.00% | |
| ingress-to-oauth-server-new-connections | 4.19 | arm64 | ovn | aws | ha | 148 | 0s | 0.00% | 7.3s | 551.79% | |
| host-to-host-new-connections | 4.19 | amd64 | ovn | vsphere | ha | 600 | 0s | 0.00% | 44s | 2757.14% | |
| kube-api-http2-service-network-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 2.45s | 0.00% | 4s | 33.33% |
| ingress-to-console-new-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 0s | 0.00% | 1.23s | 434.78% |
| host-to-host-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 1s | 0.00% | 5.7s | 28400.00% | |
| openshift-api-http2-internal-lb-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 4s | 0.00% | 6.64s | 564.00% |
| azure-network-liveness-reused-connections | 4.19 | amd64 | ovn | aws | ha | 823 | 0s | 0.00% | 1s | 400.00% | |
| ingress-to-oauth-server-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1.2s | 0.00% | 30m29.36s | 182836.00% |
| openshift-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 1s | 0.00% | 7.03s | 134.33% |
| ci-cluster-network-liveness-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 970ms | 708.33% | |
| openshift-api-reused-connections | 4.19 | amd64 | ovn | gcp | ha | 370 | 0s | 0.00% | 1s | 212.50% | |
| gcp-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | azure | ha | 537 | 4m51.4s | 0.00% | 6m54.4s | 6806.67% |
| cache-openshift-api-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 6.87s | 587.00% |
| ingress-to-console-reused-connections | 4.19 | 4.19 | arm64 | ovn | aws | ha | 179 | 0s | 0.00% | 3.32s | 232.00% |
| gcp-network-liveness-new-connections | 4.19 | s390x | ovn | libvirt | ha | 120 | 1m58s | 0.00% | 3m40.16s | 27420.00% | |
| kube-api-http1-localhost-reused-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m8.4s | 0.00% | 1m33.04s | 39.36% |
| image-registry-new-connections | 4.19 | 4.19 | arm64 | ovn | aws | ha | 179 | 1s | 0.00% | 2.66s | 33.00% |
| kube-api-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 0s | 0.00% | 7.74s | 158.00% |
| ci-cluster-network-liveness-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | single | 486 | 0s | 0.00% | 11s | 1000.00% |
| cache-openshift-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 29m14.44s | 175344.00% |
| kube-api-http1-internal-lb-new-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 4s | 0.00% | 6s | 500.00% |
| openshift-api-http2-localhost-reused-connections | 4.19 | 4.18 | amd64 | ovn | vsphere | ha | 100 | 1m12.4s | 0.00% | 1m39.04s | 41.04% |
| ingress-to-console-reused-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 2s | 100.00% |
| kube-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 30m27.92s | 182692.00% |
| ci-cluster-network-liveness-new-connections | 4.19 | arm64 | ovn | aws | ha | 148 | 2s | 0.00% | 13.65s | 4165.62% | |
| gcp-network-liveness-new-connections | 4.19 | arm64 | ovn | aws | ha | 148 | 1m37.4s | 0.00% | 5m39.81s | 20620.12% | |
| openshift-api-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 0s | 0.00% | 9.61s | 721.37% |
| openshift-api-http2-internal-lb-reused-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 0s | 0.00% | 2s | 100.00% | |
| host-to-host-new-connections | 4.19 | 4.19 | amd64 | ovn | azure | ha | 537 | 0s | 0.00% | 1s | 376.19% |
| metrics-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 29m17s | 175600.00% |
| gcp-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | external | 869 | 5s | 0.00% | 3m49.24s | 69.81% | |
| kube-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 3.88s | 223.33% | |
| ingress-to-console-reused-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 1s | 0.00% | 2s | 100.00% |
| pod-to-service-new-connections | 4.19 | amd64 | ovn | azure | ha | 179 | 0s | 0.00% | 1.88s | 88.00% | |
| cache-kube-api-new-connections | 4.19 | amd64 | ovn | gcp | ha | 166 | 1s | 0.00% | 2.7s | 33.66% | |
| pod-to-host-new-connections | 4.19 | amd64 | ovn | metal | ha | 263 | 0s | 0.00% | 16m25.7s | 32756.67% | |
| metrics-api-new-connections | 4.19 | amd64 | ovn | rosa | ha | 104 | 0s | 0.00% | 5.82s | 340.91% | |
| image-registry-new-connections | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 772 | 2s | 0.00% | 31m11.69s | 34496.86% |
| ci-cluster-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | ha | 823 | 0s | 0.00% | 5.78s | 478.00% | |
| openshift-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 30m27.92s | 182692.00% |
| ingress-to-console-new-connections | 4.19 | 4.19 | amd64 | ovn | aws | ha | 1014 | 2s | 0.00% | 5.87s | 46.75% |
| gcp-network-liveness-new-connections | 4.19 | amd64 | ovn | azure | ha | 179 | 3m13.7s | 0.00% | 5m34.42s | 3743.91% | |
| cache-kube-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 29m14.44s | 175344.00% |
| azure-network-liveness-new-connections | 4.19 | amd64 | ovn | azure | ha | 179 | 3m40.9s | 0.00% | 8m12.1s | 3120.55% | |
| cache-oauth-api-reused-connections | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 937 | 1s | 0.00% | 29m17s | 175600.00% |
| openshift-api-http2-localhost-new-connections | 4.19 | amd64 | ovn | aws | ha | 822 | 1m33.95s | 0.00% | 3m16s | 101.83% | |
| ci-cluster-network-liveness-new-connections | 4.19 | amd64 | ovn | aws | microshift | 223 | 0s | 0.00% | 6.78s | 242.42% | |
| azure-network-liveness-reused-connections | 4.20 | amd64 | ovn | aws | external | 679 | 0s | 0.00% | 1s | 212.50% | |
| gcp-network-liveness-new-connections | 4.20 | s390x | ovn | libvirt | ha | 122 | 36.75s | 0.00% | 5m50.72s | 6593.13% | |
| metrics-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 18m46.14s | 37438.00% |
| openshift-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.22s | 38240.67% |
| ci-cluster-network-liveness-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 2s | 0.00% | 17.48s | 58.91% |
| ingress-to-oauth-server-reused-connections | 4.20 | 4.20 | amd64 | ovn | aws | ha | 645 | 0s | 0.00% | 2s | 100.00% |
| ci-cluster-network-liveness-new-connections | 4.20 | 4.20 | arm64 | ovn | aws | ha | 162 | 0s | 0.00% | 6.12s | 3500.00% |
| kube-api-http1-service-network-reused-connections | 4.20 | 4.20 | amd64 | ovn | azure | ha | 588 | 1s | 0.00% | 2s | 100.00% |
| ci-cluster-network-liveness-new-connections | 4.20 | 4.19 | amd64 | ovn | azure | ha | 1017 | 1s | 0.00% | 6s | 100.00% |
| ci-cluster-network-liveness-new-connections | 4.20 | heterogeneous | ovn | aws | ha | 283 | 0s | 0.00% | 4s | 426.32% | |
| kube-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.22s | 114922.00% |
| openshift-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 4.78s | 139.00% |
| image-registry-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 2s | 0.00% | 31m6.96s | 46574.00% |
| cache-oauth-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 18m44.92s | 37397.33% |
| gcp-network-liveness-new-connections | 4.20 | 4.19 | amd64 | ovn | azure | ha | 1017 | 49.4s | 0.00% | 6m8.76s | 3276.92% |
| cache-oauth-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 5s | 66.67% |
| kube-api-http2-internal-lb-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 3s | 0.00% | 5.74s | 474.00% |
| kube-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.22s | 46656.91% |
| metrics-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 17m58.22s | 107722.00% |
| kube-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 0s | 0.00% | 5s | 66.67% |
| ingress-to-console-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 9.9s | 98.00% |
| azure-network-liveness-new-connections | 4.20 | s390x | ovn | libvirt | ha | 122 | 1m21.15s | 0.00% | 7m54.27s | 5888.26% | |
| ingress-to-oauth-server-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m12.48s | 33208.67% |
| oauth-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.48s | 28662.00% |
| openshift-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.22s | 114922.00% |
| cache-openshift-api-reused-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 0s | 0.00% | 1.78s | 78.00% |
| oauth-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.22s | 114922.00% |
| ingress-to-console-reused-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 2s | 100.00% |
| service-load-balancer-with-pdb-new-connections | 4.20 | 4.20 | heterogeneous | ovn | aws | ha | 135 | 0s | 0.00% | 1s | 138.10% |
| cache-kube-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 0s | 0.00% | 4.78s | 135.47% |
| cache-openshift-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 4.56s | 52.00% |
| pod-to-pod-new-connections | 4.20 | s390x | ovn | libvirt | ha | 122 | 0s | 0.00% | 790ms | 119.44% | |
| cache-kube-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 18m45.92s | 56196.00% |
| ingress-to-oauth-server-new-connections | 4.20 | heterogeneous | ovn | aws | ha | 283 | 0s | 0.00% | 2s | 100.00% | |
| service-load-balancer-with-pdb-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 3s | 0.00% | 28m20.8s | 56593.33% |
| ingress-to-console-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m10.48s | 114948.00% |
| metrics-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 6.78s | 239.00% |
| image-registry-reused-connections | 4.20 | 4.20 | amd64 | ovn | aws | ha | 645 | 0s | 0.00% | 2s | 100.00% |
| oauth-api-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 5s | 66.67% |
| ingress-to-oauth-server-new-connections | 4.20 | 4.20 | heterogeneous | ovn | aws | ha | 135 | 1s | 0.00% | 2.66s | 87.32% |
| pod-to-service-reused-connections | 4.20 | 4.20 | amd64 | ovn | aws | single | 546 | 5s | 0.00% | 7s | 40.00% |
| kube-api-http1-internal-lb-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 3s | 0.00% | 5s | 400.00% |
| openshift-api-http2-internal-lb-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 3s | 0.00% | 5.74s | 474.00% |
| ingress-to-console-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m11.74s | 38291.33% |
| cache-oauth-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 17m57.22s | 107622.00% |
| cache-openshift-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 17m57.22s | 107622.00% |
| cache-openshift-api-new-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 18m45.66s | 56183.00% |
| ingress-to-oauth-server-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 19m12.22s | 115122.00% |
| azure-network-liveness-new-connections | 4.20 | 4.19 | amd64 | ovn | azure | ha | 1017 | 1m8.4s | 0.00% | 9m15s | 2612.61% |
| pod-to-service-new-connections | 4.20 | 4.20 | amd64 | ovn | aws | single | 546 | 5s | 0.00% | 7s | 40.00% |
| ingress-to-console-reused-connections | 4.20 | 4.20 | amd64 | ovn | aws | ha | 645 | 0s | 0.00% | 3s | 50.00% |
| host-to-service-reused-connections | 4.20 | amd64 | ovn | metal | compact | 103 | 0s | 0.00% | 1.96s | 553.33% | |
| cache-kube-api-reused-connections | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 1027 | 1s | 0.00% | 17m56s | 107500.00% |
| service-load-balancer-with-pdb-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 1s | 0.00% | 8.24s | 37.33% |
| kube-api-http1-internal-lb-new-connections | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 623 | 0s | 0.00% | 1.78s | 5833.33% |
| image-registry-new-connections | 4.20 | 4.19 | amd64 | ovn | aws | ha | 1107 | 1s | 0.00% | 4s | 33.33% |
alerts Information
There were (11344) added jobs and (2642) were removed.
Comparisons were above allowed leeway of 30.00%
Note: For P99, alerts had 44 jobs increased and 494 jobs decreased.
Click To Show Table
| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase |
|---|---|---|---|---|---|---|---|---|---|---|---|
| KubeJobFailed openshift-insights Warning | 4.19 | arm64 | ovn | aws | ha | 154 | 3h1m31.4s | 364.04% | 4h36m15.08s | 30.68% | |
| TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning | 4.20 | amd64 | ovn | metal | ha | 319 | 1h36m3.4s | 39.58% | 1h43m22.56s | 36.41% | |
| NodeSystemSaturation openshift-monitoring Warning | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 280 | 17m36.8s | 116.34% | 29m6.6s | 48.27% |
| KubeletPlegDurationHigh kube-system Warning | 4.20 | 4.20 | amd64 | ovn | gcp | ha | 280 | 4m58s | 101.35% | 6m58s | 75.63% |
| KubeletPlegDurationHigh kube-system Warning | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 335 | 4m37s | 55.62% | 6m47.8s | 36.85% |
| NodeSystemSaturation openshift-monitoring Warning | 4.19 | 4.19 | amd64 | ovn | gcp | ha | 335 | 10m59.6s | 0.00% | 32m36.24s | 77.36% |
| KubeletPlegDurationHigh kube-system Warning | 4.19 | 4.18 | amd64 | ovn | gcp | ha | 277 | 0s | 0.00% | 2m42.4s | 180.00% |
| KubeletPlegDurationHigh kube-system Warning | 4.19 | 4.19 | amd64 | ovn | azure | ha | 293 | 0s | 0.00% | 2m28s | 428.57% |
| SystemMemoryExceedsReservation openshift-machine-config-operator Warning | 4.19 | amd64 | ovn | gcp | ha | 225 | 0s | 0.00% | 6m7.2s | 42.51% | |
| KubeletPlegDurationHigh kube-system Warning | 4.20 | 4.19 | amd64 | ovn | gcp | ha | 187 | 0s | 0.00% | 3m19s | 8783.93% |
| KubeletPlegDurationHigh kube-system Warning | 4.20 | amd64 | ovn | azure | ha | 133 | 0s | 0.00% | 3m18.4s | 280.08% | |
| KubeletPlegDurationHigh kube-system Warning | 4.20 | amd64 | ovn | gcp | ha | 165 | 2m52s | 0.00% | 5m38.8s | 31.27% | |
| KubeletPlegDurationHigh kube-system Warning | 4.20 | 4.20 | amd64 | ovn | azure | ha | 207 | 0s | 0.00% | 1m24.4s | 201.43% |
| NodeSystemSaturation openshift-monitoring Warning | 4.20 | amd64 | ovn | azure | ha | 133 | 40s | 0.00% | 4m27.04s | 58.01% | |
| KubeJobFailed openshift-insights Warning | 4.20 | amd64 | ovn | vsphere | ha | 187 | 2h1m25s | 0.00% | 4h50m16.84s | 82.51% | |
| KubeJobFailed openshift-insights Warning | 4.20 | arm64 | ovn | aws | ha | 147 | 2h36m17.6s | 0.00% | 4h19m27.32s | 81.57% |
@openshift-bot: This pull request explicitly references no jira issue.
In response to this:
disruptions Information
There were (
276) added jobs and (0) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, disruptions had
485jobs increased and1353jobs decreased.Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase pod-to-host-new-connections 4.19 amd64 ovn metal ha 216 2m39.5s 15850.00% 46m7.9s 92163.33% openshift-api-http2-localhost-new-connections 4.19 amd64 ovn vsphere ha 368 3m56.9s 192.47% 4m29s 228.05% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 515 2m38.7s 1693.22% 7m40.74s 70.95% kube-api-http1-localhost-new-connections 4.19 amd64 ovn azure ha 298 3m34s 229.23% 3m48.06s 204.40% kube-api-http1-localhost-new-connections 4.19 amd64 ovn vsphere ha 368 3m29.85s 199.79% 3m55.32s 226.83% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 515 1m38.5s 1541.67% 5m6.76s 86.66% azure-network-liveness-new-connections 4.19 amd64 ovn gcp ha 368 1m16.3s 478.03% 9m25.48s 200.76% azure-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 147 54.7s 567.07% 10m45.98s 37.57% gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn aws ha 879 38.8s 676.00% 7m52.62s 95.62% azure-network-liveness-new-connections 4.20 amd64 ovn aws external 568 31.65s 2537.50% 2m58.33s 220.97% gcp-network-liveness-new-connections 4.20 amd64 ovn aws external 568 28.95s 1709.38% 1m54.66s 88.34% gcp-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 147 27s 558.54% 6m52.24s 38.67% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1027 20s 589.66% 7m19.7s 101.27% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1027 25.7s 157.00% 11m22.58s 65.34% azure-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1040 16s 130.22% 8m20.55s 1314.38% azure-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1184 14.55s 142.50% 5m21s 69.38% gcp-network-liveness-new-connections 4.19 amd64 ovn gcp ha 303 12.9s 152.94% 3m15.82s 74.03% host-to-host-new-connections 4.19 4.19 amd64 ovn aws ha 515 9.6s 418.92% 1m12.18s 32.78% gcp-network-liveness-new-connections 4.19 amd64 ovn aws ha 198 8.75s 775.00% 6m26.97s 183.49% azure-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 926 15.5s 93.75% 11m0.25s 40.85% gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 926 9.75s 191.04% 7m28.75s 45.53% gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1184 6s 200.00% 3m50.54s 86.73% gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1040 6s 200.00% 5m54.12s 1149.54% pod-to-host-new-connections 4.20 4.20 amd64 ovn aws ha 546 6s 100.00% 1m7s 108.07% ci-cluster-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 762 4.95s 65.00% 2m38.78s 760.13% image-registry-new-connections 4.20 4.19 amd64 ovn aws ha 1040 2s 100.00% 6.61s 120.33% ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn aws ha 546 3s 50.00% 10.1s 68.33% cache-openshift-api-reused-connections 4.19 amd64 ovn vsphere ha 147 0s 0.00% 1s 61.29% pod-to-pod-reused-connections 4.19 amd64 ovn vsphere ha 498 0s 0.00% 10.08s 1300.00% service-load-balancer-with-pdb-new-connections 4.19 amd64 ovn gcp ha 303 1s 0.00% 3s 200.00% openshift-api-http2-internal-lb-reused-connections 4.19 amd64 ovn aws ha 627 10s 0.00% 21s 107.72% metrics-api-new-connections 4.19 4.19 amd64 ovn azure ha 382 0s 0.00% 27.57s 44.35% cache-oauth-api-reused-connections 4.19 4.19 amd64 ovn azure ha 382 2s 0.00% 3.19s 44.34% azure-network-liveness-reused-connections 4.19 4.18 amd64 ovn azure ha 926 0s 0.00% 2s 100.00% image-registry-new-connections 4.19 amd64 ovn aws ha 198 0s 0.00% 23.03s 2203.00% openshift-api-http2-localhost-new-connections 4.19 amd64 ovn aws ha 627 1m32.7s 0.00% 3m20.48s 106.45% gcp-network-liveness-new-connections 4.19 s390x ovn libvirt ha 116 0s 0.00% 1.85s 131.25% oauth-api-new-connections 4.19 amd64 ovn metal ha 197 0s 0.00% 1m9.04s 36.98% host-to-host-new-connections 4.19 amd64 ovn vsphere ha 499 0s 0.00% 22.46s 1358.44% kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 1.86s 86.00% openshift-api-http2-internal-lb-new-connections 4.19 4.19 amd64 ovn azure ha 382 0s 0.00% 2.33s 133.00% gcp-network-liveness-new-connections 4.19 ppc64le ovn libvirt ha 351 0s 0.00% 1s 127.27% gcp-network-liveness-new-connections 4.19 arm64 ovn aws ha 106 0s 0.00% 41.8s 2448.78% host-to-host-new-connections 4.19 4.19 amd64 ovn azure ha 382 0s 0.00% 1.19s 466.67% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws ha 627 0s 0.00% 19.48s 1848.00% kube-api-http2-service-network-reused-connections 4.19 amd64 ovn azure ha 298 1s 0.00% 14s 1358.33% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 313 1m7.4s 0.00% 14m1.08s 10033.49% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 382 950ms 0.00% 8m45.6s 6470.00% azure-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 295 0s 0.00% 51.68s 1096.30% kube-api-http1-localhost-reused-connections 4.19 amd64 ovn aws ha 627 1m22s 0.00% 2m58.66s 109.92% gcp-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 295 0s 0.00% 49.12s 1375.08% ci-cluster-network-liveness-new-connections 4.19 arm64 ovn aws ha 251 0s 0.00% 6s 1775.00% host-to-service-new-connections 4.19 amd64 ovn vsphere ha 493 0s 0.00% 3.48s 180.65% kube-api-new-connections 4.19 4.18 amd64 ovn aws ha 879 0s 0.00% 6.18s 34.35% azure-network-liveness-new-connections 4.19 amd64 ovn azure ha 211 0s 0.00% 4m14.2s 1563.61% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn gcp ha 368 650ms 0.00% 35.63s 122.69% cache-kube-api-new-connections 4.19 4.18 amd64 ovn aws ha 879 0s 0.00% 1s 66.67% image-registry-reused-connections 4.19 amd64 ovn metal ha 123 1s 0.00% 6m50.84s 5451.89% cache-kube-api-reused-connections 4.19 4.18 amd64 ovn azure ha 926 2s 0.00% 3s 50.00% host-to-pod-new-connections 4.19 amd64 ovn vsphere ha 498 0s 0.00% 26.57s 1177.40% kube-api-http1-internal-lb-reused-connections 4.19 amd64 ovn vsphere ha 368 0s 0.00% 1s 61.29% kube-api-http2-internal-lb-reused-connections 4.19 amd64 ovn aws ha 627 10s 0.00% 20s 97.82% kube-api-reused-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 1.72s 72.00% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 313 34.2s 0.00% 9m44.28s 11356.47% openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 2s 70.94% kube-api-http1-localhost-new-connections 4.19 amd64 ovn aws ha 627 1m22s 0.00% 2m57.92s 109.05% image-registry-reused-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 1.86s 58.97% cache-kube-api-new-connections 4.19 amd64 ovn gcp ha 303 0s 0.00% 2.98s 47.52% pod-to-host-new-connections 4.19 ppc64le ovn libvirt ha 351 0s 0.00% 2m7s 14331.82% ingress-to-console-new-connections 4.19 arm64 ovn aws ha 106 750ms 0.00% 2.9s 190.00% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 515 2s 0.00% 31s 1450.00% azure-network-liveness-reused-connections 4.19 4.19 amd64 ovn gcp ha 1027 0s 0.00% 2s 100.00% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws microshift 190 0s 0.00% 11s 455.56% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 382 0s 0.00% 5m38.02s 5533.67% kube-api-http1-service-network-reused-connections 4.19 amd64 ovn aws ha 627 0s 0.00% 1s 809.09% pod-to-host-reused-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 9.44s 182.63% gcp-network-liveness-new-connections 4.19 amd64 ovn azure ha 211 0s 0.00% 2m53.6s 1895.40% ingress-to-oauth-server-new-connections 4.19 amd64 ovn metal ha 216 0s 0.00% 1m8.6s 37.75% oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 515 0s 0.00% 3s 123.88% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 313 1s 0.00% 38s 3700.00% oauth-api-new-connections 4.19 4.18 amd64 ovn aws ha 879 0s 0.00% 6s 100.00% image-registry-reused-connections 4.19 4.18 amd64 ovn aws ha 879 0s 0.00% 1s 66.67% azure-network-liveness-reused-connections 4.19 amd64 ovn aws ha 627 0s 0.00% 1s 400.00% host-to-host-new-connections 4.19 amd64 ovn gcp ha 368 0s 0.00% 14.99s 74850.00% oauth-api-reused-connections 4.19 amd64 ovn vsphere ha 499 1s 0.00% 5s 706.45% ci-cluster-network-liveness-new-connections 4.20 4.20 arm64 ovn aws ha 119 100ms 0.00% 32.6s 19076.47% cache-openshift-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 33.22s 69.75% kube-api-new-connections 4.20 4.19 amd64 ovn aws ha 1040 0s 0.00% 10s 233.33% metrics-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 34.76s 50.74% ingress-to-oauth-server-reused-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 4s 300.00% oauth-api-new-connections 4.20 4.19 amd64 ovn aws ha 1040 0s 0.00% 10s 233.33% cache-oauth-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 33.4s 63.73% host-to-host-new-connections 4.20 4.20 amd64 ovn aws ha 546 4s 0.00% 1m24.7s 82.94% kube-api-http1-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 569 0s 0.00% 320ms 966.67% host-to-host-new-connections 4.20 4.20 amd64 ovn azure ha 499 0s 0.00% 14.24s 1324.00% cache-oauth-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 15.55s 204.90% oauth-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 34.32s 97.01% metrics-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 15.55s 204.90% kube-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 29.48s 44.65% cache-kube-api-new-connections 4.20 4.19 amd64 ovn aws ha 1040 0s 0.00% 4.05s 938.46% openshift-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 34.12s 43.84% cache-kube-api-new-connections 4.20 4.20 arm64 ovn aws ha 119 0s 0.00% 38.24s 119.27% gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1121 0s 0.00% 1m51.6s 921.98% openshift-api-new-connections 4.20 4.19 amd64 ovn aws ha 1040 0s 0.00% 9.61s 78.29% cache-oauth-api-reused-connections 4.20 4.20 amd64 ovn azure ha 499 2s 0.00% 3s 50.00% service-load-balancer-with-pdb-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 2.65s 165.00% azure-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1121 1s 0.00% 3m30.6s 929.33% kube-api-reused-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 3.55s 54.35% kube-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 16s 88.24% ingress-to-console-new-connections 4.20 4.19 amd64 ovn aws ha 1040 1s 0.00% 6s 50.00% openshift-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 16s 50.94% image-registry-reused-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 2s 100.00% cache-kube-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 16s 213.73% host-to-host-reused-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 13.55s 652.78% ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 569 6s 0.00% 50.32s 214.50% oauth-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 16s 70.21% cache-openshift-api-new-connections 4.20 4.20 amd64 ovn aws ha 546 0s 0.00% 16s 213.73% ingress-to-oauth-server-new-connections 4.20 4.19 amd64 ovn aws ha 1040 1s 0.00% 7.61s 73.35% ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1040 0s 0.00% 18s 800.00% ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1184 1s 0.00% 37.1s 237.27% ci-cluster-network-liveness-new-connections 4.20 heterogeneous ovn aws ha 193 0s 0.00% 21.12s 2678.95% alerts Information
There were (
2570) added jobs and (2256) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, alerts had
74jobs increased and376jobs decreased./cc @dgoodwin, @neisw, @DennisPeriquetClick To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase KubeJobFailed openshift-insights Warning 4.19 arm64 ovn aws ha 103 2h15m31.2s 246.44% 4h41m45.92s 33.29% etcdHighCommitDurations openshift-etcd Warning 4.20 4.19 amd64 ovn azure ha 269 28m48.8s 905.12% 1h1m13.92s 370.10% NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn gcp ha 317 21m31.2s 164.32% 27m14.72s 38.77% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn gcp ha 317 20m26s 103.15% 23m36.8s 72.57% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn gcp ha 209 20m26s 101.38% 22m56s 38.88% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn gcp ha 317 20m33.6s 77.50% 24m52.56s 76.74% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn gcp ha 209 23m39.2s 56.09% 29m48.8s 61.39% NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn aws single 177 18m26s 42.53% 19m26s 34.64% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn aws ha 296 15m5s 48.48% 19m33.5s 59.29% NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn azure ha 205 7m20s 201.37% 17m44.48s 494.55% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn aws ha 290 14m14.5s 36.50% 19m9.2s 48.09% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn azure ha 125 5m38s 186.44% 7m12.08s 38.84% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn azure ha 205 5m28s 78.26% 13m44.8s 207.76% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn azure ha 205 7m10s 31.10% 13m55.6s 85.52% KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws ha 278 1h16m29.5s 0.00% 4h51m59.16s 57.56% NodeSystemSaturation openshift-monitoring Warning 4.19 4.18 amd64 ovn gcp ha 176 15m59s 0.00% 36m56.5s 56.58% etcdHighCommitDurations openshift-etcd Warning 4.19 4.19 amd64 ovn azure ha 179 0s 0.00% 12m47.12s 443.67% IngressControllerUnavailable openshift-ingress-operator Warning 4.19 4.19 amd64 ovn gcp ha 248 0s 0.00% 1m15.7s 214.37% KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn azure ha 119 2.8s 0.00% 4m17.2s 72.02% KubeletPlegDurationHigh kube-system Warning 4.19 4.19 amd64 ovn azure ha 179 0s 0.00% 2m17.8s 392.14% SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.19 amd64 ovn gcp ha 129 0s 0.00% 13m7.68s 205.71% SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.19 heterogeneous ovn aws ha 102 0s 0.00% 51.48s 221.35% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn azure ha 119 2m28s 0.00% 10m48.2s 55.37% etcdHighCommitDurations openshift-etcd Warning 4.20 amd64 ovn azure ha 125 0s 0.00% 3m0.88s 617.78% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn aws ha 241 23m50s 0.00% 43m0s 36.97% SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.20 4.19 amd64 ovn aws ha 290 0s 0.00% 7m42.84s 108.73% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn aws ha 290 21m25.1s 0.00% 35m27s 47.80% OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.20 4.19 amd64 ovn aws ha 290 56m48s 0.00% 1h17m24.6s 36.29% KubeletPlegDurationHigh kube-system Warning 4.20 4.20 amd64 ovn gcp ha 317 2m28s 0.00% 5m43.6s 44.37% NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws ha 296 20m29.5s 0.00% 42m12.2s 30.79% NodeClockNotSynchronising openshift-monitoring Critical 4.20 amd64 ovn metal ha 271 0s 0.00% 4h51m28s 63.29% NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws single 107 21m17s 0.00% 24m52.4s 42.51% KubeletPlegDurationHigh kube-system Warning 4.20 amd64 ovn metal ha 271 0s 0.00% 10m1s 34.15% KubeletPlegDurationHigh kube-system Warning 4.20 4.20 amd64 ovn azure ha 205 0s 0.00% 2m26.8s 424.29% KubeletPlegDurationHigh kube-system Warning 4.20 4.19 amd64 ovn gcp ha 209 0s 0.00% 3m28s 9185.71% OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.20 amd64 ovn aws ha 296 56m48s 0.00% 1h21m25.5s 1146.56% HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn aws ha 241 16m58s 0.00% 24m56s 31.97% ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn gcp ha 151 13m57s 0.00% 26m56s 70.69% KubeJobFailed openshift-insights Warning 4.20 arm64 ovn aws ha 113 58m43.2s 0.00% 4h47m37.44s 101.29% OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.20 4.19 amd64 ovn gcp ha 209 1h7m58.8s 0.00% 1h22m40.8s 44.55% KubeletPlegDurationHigh kube-system Warning 4.20 amd64 ovn azure ha 125 0s 0.00% 3m30.4s 303.07% OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning 4.20 4.20 amd64 ovn aws ha 241 57m18s 0.00% 1h30m36s 49.21% NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn azure ha 125 1m58s 0.00% 13m12.96s 369.21%
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.
Job Failure Risk Analysis for sha: 3012b949e1bf4ca91b8aa9ca4e5da1b30f34212e
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | IncompleteTests Tests for this run (2125) are below the historical average (3123): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Medium [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available Potential external regression detected for High Risk Test analysis Open Bugs openshift-apiserver ClusterOperator should not blip Available=False on brief missing HTTP content-type |
/lgtm
/retest-required
/retest-required
Remaining retests: 0 against base HEAD f87f59bd96f2d818aecfdd084d1b1bf5d0617e36 and 2 for PR HEAD 80dcd2387843b1516cc55694dea0ae47dbef9904 in total
Job Failure Risk Analysis for sha: 80dcd2387843b1516cc55694dea0ae47dbef9904
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [sig-node] node-lifecycle detects unexpected not ready node Potential external regression detected for High Risk Test analysis Open Bugs node-lifecycle detects unexpected not ready node failing on azure serial and upgrade jobs --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling | Low [bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available This test has passed 69.34% of 3611 runs on release 4.20 [Overall] in the last week. --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week. |
@openshift-bot: This pull request explicitly references no jira issue.
In response to this:
disruptions Information
There were (
992) added jobs and (120) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, disruptions had
642jobs increased and1616jobs decreased.Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase azure-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 347 8m47.4s 52640.00% 11m14.32s 8329.00% azure-network-liveness-new-connections 4.19 amd64 ovn gcp ha 163 8m47s 3892.42% 16m43.16s 433.54% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 827 7m16.1s 4261.00% 13m42.22s 99.16% azure-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 749 7m9.4s 5267.50% 15m43.72s 101.32% azure-network-liveness-new-connections 4.19 4.18 amd64 ovn aws ha 885 7m4.5s 4145.00% 14m38.88s 176.73% gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 755 6m50.1s 8020.79% 9m5s 59.91% azure-network-liveness-new-connections 4.20 4.20 arm64 ovn aws ha 172 6m39.5s 4105.26% 11m55.8s 38.98% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 651 6m35.5s 4368.93% 9m42s 115.95% gcp-network-liveness-new-connections 4.19 amd64 ovn gcp ha 163 6m24s 7429.41% 11m51.58s 532.40% azure-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 5m27.4s 5356.67% 13m14.44s 319.19% azure-network-liveness-new-connections 4.19 amd64 ovn aws ha 790 5m23s 14255.56% 13m7.66s 87.20% gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 749 5m9.6s 9141.79% 10m41.72s 108.11% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 827 4m51.7s 9958.62% 9m46.22s 168.34% gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn aws ha 885 4m34.95s 5399.00% 9m51.33s 144.76% azure-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 567 4m35.1s 3254.88% 12m13.7s 56.25% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 651 4m30.5s 4408.33% 6m58s 154.35% gcp-network-liveness-new-connections 4.20 4.20 arm64 ovn aws ha 172 4m0.8s 3047.71% 8m36.22s 67.34% gcp-network-liveness-new-connections 4.19 amd64 ovn aws ha 790 3m42.5s 22150.00% 9m4.65s 299.01% gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 3m33.2s 10560.00% 8m20.76s 305.61% gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1123 3m23.95s 10097.50% 7m47.11s 1548.24% gcp-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 567 3m4.6s 4402.44% 7m23.46s 49.17% azure-network-liveness-new-connections 4.20 amd64 ovn aws external 710 2m43.1s 13491.67% 14m59.83s 1519.56% gcp-network-liveness-new-connections 4.20 amd64 ovn aws external 710 1m53s 6962.50% 9m52.06s 872.50% azure-network-liveness-new-connections 4.20 4.20 heterogeneous ovn aws ha 136 2m7.5s 341.18% 7m43.65s 40.16% gcp-network-liveness-new-connections 4.20 amd64 ovn rosa ha 103 27s 3757.14% 2m31.54s 81.40% azure-network-liveness-new-connections 4.20 amd64 ovn rosa ha 103 24.5s 1066.67% 5m20.78s 77.66% ci-cluster-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 755 7.5s 150.00% 2m38.92s 760.89% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn gcp ha 163 3s 200.00% 52.84s 230.25% ingress-to-console-new-connections 4.19 4.19 arm64 ovn aws ha 159 2s 100.00% 4.84s 61.33% ingress-to-oauth-server-new-connections 4.19 4.19 arm64 ovn aws ha 159 2s 100.00% 4.84s 62.42% ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn aws ha 684 3s 50.00% 9s 50.00% image-registry-new-connections 4.20 4.19 amd64 ovn aws ha 1123 2s 100.00% 6s 100.00% oauth-api-reused-connections 4.19 amd64 ovn azure ha 303 1.9s 90.00% 3.98s 31.79% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn metal ha 219 1.1s 0.00% 33.82s 3497.87% metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 9.44s 136.00% host-to-pod-new-connections 4.19 amd64 ovn vsphere ha 566 0s 0.00% 41.4s 1890.38% gcp-network-liveness-new-connections 4.19 amd64 ovn aws external 820 32.1s 0.00% 3m54.81s 73.93% ingress-to-oauth-server-new-connections 4.19 arm64 ovn aws ha 150 0s 0.00% 1.51s 34.82% host-to-service-new-connections 4.19 heterogeneous ovn aws ha 556 0s 0.00% 1s 203.03% azure-network-liveness-reused-connections 4.19 4.18 amd64 ovn gcp ha 755 1s 0.00% 3s 50.00% image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 827 2s 0.00% 26m16.66s 31433.20% pod-to-service-reused-connections 4.19 amd64 ovn metal ha 246 0s 0.00% 5m5.65s 140.37% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 314 2s 0.00% 38s 3700.00% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 347 6m11.8s 0.00% 7m32.16s 7436.00% host-to-service-new-connections 4.19 arm64 ovn aws ha 385 0s 0.00% 1s 1566.67% kube-api-http2-internal-lb-new-connections 4.19 amd64 ovn vsphere ha 423 0s 0.00% 4.56s 52.00% ingress-to-console-new-connections 4.19 4.19 amd64 ovn aws ha 651 2s 0.00% 6s 50.00% pod-to-host-new-connections 4.19 amd64 ovn gcp ha 359 0s 0.00% 22.46s 6918.75% image-registry-new-connections 4.19 amd64 ovn gcp ha 163 0s 0.00% 4.42s 46.36% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws ha 790 0s 0.00% 17.11s 1611.00% gcp-network-liveness-new-connections 4.19 amd64 ovn azure ha 168 4m33.3s 0.00% 6m27.28s 4351.49% cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 6s 100.00% cache-openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 3s 200.00% openshift-api-reused-connections 4.19 amd64 ovn gcp ha 163 0s 0.00% 1s 212.50% openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 4s 241.88% ingress-to-console-reused-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 2s 100.00% cache-kube-api-reused-connections 4.19 amd64 ovn azure ha 168 1s 0.00% 1.33s 33.00% gcp-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 556 52.75s 0.00% 3m27.05s 6117.72% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 314 10m22.4s 0.00% 14m0.17s 10022.53% azure-network-liveness-new-connections 4.19 ppc64le ovn libvirt ha 302 43.65s 0.00% 4m3.52s 16811.11% gcp-network-liveness-new-connections 4.19 amd64 ovn metal single 132 4.45s 0.00% 14.45s 189.00% cache-oauth-api-new-connections 4.19 amd64 ovn gcp ha 163 900ms 0.00% 2s 100.00% kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 4s 300.00% image-registry-reused-connections 4.19 4.18 amd64 ovn aws ha 885 0s 0.00% 1s 66.67% kube-api-http2-service-network-reused-connections 4.19 amd64 ovn azure ha 301 0s 0.00% 14s 1358.33% kube-api-http2-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 827 700ms 0.00% 5s 400.00% cache-kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 6.74s 124.67% image-registry-reused-connections 4.19 4.18 amd64 ovn gcp ha 755 1s 0.00% 22m14.44s 133344.00% azure-network-liveness-reused-connections 4.19 4.19 amd64 ovn gcp ha 827 0s 0.00% 2s 100.00% kube-api-http1-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 827 0s 0.00% 5s 400.00% cache-kube-api-reused-connections 4.19 4.18 amd64 ovn azure ha 749 2s 0.00% 3s 50.00% gcp-network-liveness-new-connections 4.19 arm64 ovn aws ha 385 1m2.2s 0.00% 4m32.92s 16541.46% gcp-network-liveness-new-connections 4.19 s390x ovn libvirt ha 123 1m54.7s 0.00% 3m39.08s 27285.00% host-to-host-new-connections 4.19 amd64 ovn gcp ha 163 0s 0.00% 1.76s 8700.00% image-registry-new-connections 4.19 4.18 amd64 ovn gcp ha 755 2s 0.00% 22m40.42s 25046.40% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws microshift 214 1.35s 0.00% 11.87s 499.49% azure-network-liveness-reused-connections 4.19 amd64 ovn aws ha 790 0s 0.00% 2s 900.00% kube-api-reused-connections 4.19 amd64 ovn vsphere ha 567 700ms 0.00% 7s 40.00% cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 6s 50.00% service-load-balancer-with-pdb-reused-connections 4.19 4.19 amd64 ovn gcp ha 827 3s 0.00% 4s 33.33% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 651 3s 0.00% 30.5s 1425.00% image-registry-reused-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 26m58.16s 80808.00% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 314 7m9.4s 0.00% 9m44.78s 11366.27% image-registry-reused-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 2s 70.94% kube-api-http1-localhost-new-connections 4.19 amd64 ovn aws ha 789 1m22s 0.00% 2m52.24s 102.37% kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 9.7s 223.33% azure-network-liveness-new-connections 4.19 amd64 ovn aws external 820 38.05s 0.00% 5m59.43s 66.77% openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 10.96s 174.00% oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 12.66s 216.50% azure-network-liveness-new-connections 4.19 amd64 ovn azure ha 303 4m23.7s 0.00% 9m6.76s 3478.27% ingress-to-console-reused-connections 4.19 4.19 amd64 ovn gcp ha 827 1s 0.00% 1.74s 74.00% oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 651 0s 0.00% 4s 198.51% image-registry-new-connections 4.19 4.19 arm64 ovn aws ha 159 2s 0.00% 2.84s 42.00% openshift-api-http2-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 827 0s 0.00% 5s 400.00% kube-api-reused-connections 4.19 4.19 amd64 ovn azure ha 347 2s 0.00% 6.54s 55.34% host-to-host-new-connections 4.19 4.19 amd64 ovn azure ha 347 0s 0.00% 1s 376.19% azure-network-liveness-reused-connections 4.19 4.18 amd64 ovn azure ha 749 1s 0.00% 2s 100.00% ingress-to-console-reused-connections 4.19 4.19 arm64 ovn aws ha 159 0s 0.00% 2s 100.00% pod-to-host-reused-connections 4.19 amd64 ovn vsphere ha 566 0s 0.00% 43.35s 5060.71% ci-cluster-network-liveness-new-connections 4.19 arm64 ovn aws ha 150 2s 0.00% 15.59s 4771.88% gcp-network-liveness-new-connections 4.19 ppc64le ovn libvirt ha 302 19.85s 0.00% 2m35.88s 35327.27% openshift-api-new-connections 4.19 arm64 ovn aws ha 150 0s 0.00% 2.55s 4150.00% service-load-balancer-with-pdb-new-connections 4.19 4.18 amd64 ovn azure ha 749 0s 0.00% 1.52s 52.00% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn metal compact 111 1.5s 0.00% 35.3s 2574.24% azure-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 556 1m23s 0.00% 5m46.9s 7930.09% openshift-api-http2-internal-lb-reused-connections 4.19 amd64 ovn aws ha 789 10s 0.00% 20s 97.82% azure-network-liveness-new-connections 4.19 amd64 ovn metal single 132 5s 0.00% 21.21s 146.63% cache-oauth-api-reused-connections 4.20 4.20 amd64 ovn azure ha 629 2s 0.00% 3s 50.00% service-load-balancer-with-pdb-reused-connections 4.20 4.19 amd64 ovn azure ha 1024 3s 0.00% 4s 33.33% cache-oauth-api-new-connections 4.20 4.20 heterogeneous ovn aws ha 136 0s 0.00% 650ms 54.76% cache-openshift-api-new-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 11s 115.69% oauth-api-new-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 13.51s 43.72% ci-cluster-network-liveness-new-connections 4.20 heterogeneous ovn aws ha 289 0s 0.00% 16.48s 2068.42% service-load-balancer-with-pdb-new-connections 4.20 4.20 heterogeneous ovn aws ha 136 0s 0.00% 650ms 54.76% ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 2.2s 0.00% 1m19.6s 623.64% host-to-service-reused-connections 4.20 amd64 ovn metal compact 102 0s 0.00% 1.98s 560.00% ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 690 11s 0.00% 50s 212.50% pod-to-service-new-connections 4.20 amd64 ovn metal compact 102 0s 0.00% 7.95s 44.55% kube-api-http1-service-network-reused-connections 4.20 4.20 amd64 ovn azure ha 629 1s 0.00% 2s 100.00% host-to-host-new-connections 4.20 4.20 amd64 ovn azure ha 629 0s 0.00% 13.16s 1216.00% ingress-to-oauth-server-reused-connections 4.20 ppc64le ovn libvirt ha 295 3m11.3s 0.00% 5m2.44s 31.67% azure-network-liveness-reused-connections 4.20 amd64 ovn aws external 710 0s 0.00% 1s 212.50% ci-cluster-network-liveness-new-connections 4.20 4.20 arm64 ovn aws ha 172 1.45s 0.00% 18.83s 10976.47% gcp-network-liveness-new-connections 4.20 amd64 ovn metal single 114 3.35s 0.00% 9s 581.82% ingress-to-oauth-server-new-connections 4.20 4.20 heterogeneous ovn aws ha 136 1s 0.00% 2.65s 86.62% ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1123 1s 0.00% 16s 700.00% ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1024 0s 0.00% 5.77s 92.33% gcp-network-liveness-new-connections 4.20 s390x ovn libvirt ha 121 37s 0.00% 5m51.4s 6606.11% cache-kube-api-new-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 6.85s 34.31% service-load-balancer-with-pdb-reused-connections 4.20 4.20 amd64 ovn gcp ha 1057 3s 0.00% 4s 33.33% ci-cluster-network-liveness-new-connections 4.20 amd64 ovn metal compact 102 0s 0.00% 6.95s 672.22% kube-api-http1-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 2s 0.00% 5s 400.00% azure-network-liveness-new-connections 4.20 s390x ovn libvirt ha 121 1m22s 0.00% 7m55.4s 5902.53% azure-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1024 3m0.1s 0.00% 10m52.54s 3089.35% azure-network-liveness-new-connections 4.20 ppc64le ovn libvirt ha 295 1m30.3s 0.00% 5m45.66s 147.61% metrics-api-new-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 11.68s 129.02% gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1024 1m50s 0.00% 7m58.4s 4280.95% kube-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 2s 0.00% 5s 400.00% gcp-network-liveness-new-connections 4.20 ppc64le ovn libvirt ha 295 1m6.4s 0.00% 3m39.8s 137.16% ingress-to-console-reused-connections 4.20 ppc64le ovn libvirt ha 295 3m18s 0.00% 5m6.62s 32.94% image-registry-reused-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 2.17s 117.00% kube-api-http1-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 690 0s 0.00% 1s 3233.33% ingress-to-oauth-server-reused-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 4s 300.00% cache-oauth-api-new-connections 4.20 4.20 amd64 ovn aws ha 684 0s 0.00% 6.85s 34.31% openshift-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1057 2s 0.00% 5s 400.00% azure-network-liveness-new-connections 4.20 amd64 ovn metal single 114 4.35s 0.00% 12.48s 1850.00% alerts Information
There were (
8410) added jobs and (3388) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, alerts had
53jobs increased and464jobs decreased./cc @dgoodwin, @neisw, @DennisPeriquetClick To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase KubeJobFailed openshift-insights Warning 4.20 arm64 ovn aws ha 114 4h46m39.2s 114.75% 8h19m20.4s 249.45% TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning 4.20 amd64 ovn metal ha 164 1h43m30.6s 50.41% 2h10m2.94s 71.60% NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn gcp ha 184 20m4.9s 146.65% 37m51.76s 92.85% IngressControllerUnavailable openshift-ingress-operator Warning 4.19 4.19 amd64 ovn gcp ha 177 0s 0.00% 1m58s 390.03% KubeJobFailed openshift-insights Warning 4.19 amd64 ovn vsphere ha 125 0s 0.00% 5h5m18s 54.04% KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn aws ha 195 0s 0.00% 28s 143.90% KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws ha 195 0s 0.00% 4h29m32.4s 45.44%
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.
Job Failure Risk Analysis for sha: 324391cd75d9d1d3e02d8c2ddd85c21e47417b32
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (94) are below the historical average (204): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [sig-node] static pods should start after being created This test has passed 97.68% of 3278 runs on release 4.20 [Overall] in the last week. Open Bugs [sig-node] static pods should start after being created --- [sig-node] node-lifecycle detects unexpected not ready node Potential external regression detected for High Risk Test analysis Open Bugs node-lifecycle detects unexpected not ready node failing on azure serial and upgrade jobs |
Risk analysis has seen new tests most likely introduced by this PR. Please ensure that new tests meet guidelines for naming and stability.
New Test Risks for sha: 324391cd75d9d1d3e02d8c2ddd85c21e47417b32
| Job Name | New Test Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-openstack-ovn | Medium - "[sig-installer][Suite:openshift/openstack] The OpenShift cluster should allow the manual setting of enable_topology to false [Serial]" is a new test, and was only seen in one job. |
New tests seen in this PR at sha: 324391cd75d9d1d3e02d8c2ddd85c21e47417b32
- "[sig-installer][Suite:openshift/openstack] The OpenShift cluster should allow the manual setting of enable_topology to false [Serial]" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
Job Failure Risk Analysis for sha: 063fb8a028e6b119db308136045b87488187d527
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling | Medium [sig-architecture] platform pods in ns/openshift-etcd should not exit an excessive amount of times Potential external regression detected for High Risk Test analysis Open Bugs etcd platform pod exist test failing on etcd-scaling jobs --- [bz-etcd][invariant] alert/etcdMembersDown should not be at or above info Potential external regression detected for High Risk Test analysis Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Medium [sig-instrumentation] disruption/metrics-api connection/new should be available throughout the test Potential external regression detected for High Risk Test analysis |
Job Failure Risk Analysis for sha: e499b20042650a59c26d4964285bbf27b8710332
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis Open Bugs [sig-node] static pods should start after being created |
| pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones | Medium [sig-network] Services should be rejected for evicted pods (no endpoints exist) [Suite:openshift/conformance/parallel] [Suite:k8s] This test has passed 95.19% of 2825 runs on release 4.20 [Overall] in the last week. Open Bugs Component Readiness: [Networking / cluster-network-operator] [Other] test regressed |
/lgtm
/retest-required
Remaining retests: 0 against base HEAD cec622232fc8c85be494380ee644cf90447b530e and 2 for PR HEAD b3b85fbee427cbe33684db592573594f293f1cda in total
/retest-required
Remaining retests: 0 against base HEAD cec622232fc8c85be494380ee644cf90447b530e and 2 for PR HEAD b3b85fbee427cbe33684db592573594f293f1cda in total
/retest-required
Remaining retests: 0 against base HEAD 205e55db3feafca6b56849aff1c267b72791a641 and 2 for PR HEAD b3b85fbee427cbe33684db592573594f293f1cda in total
/retest-required
Remaining retests: 0 against base HEAD 205e55db3feafca6b56849aff1c267b72791a641 and 2 for PR HEAD b3b85fbee427cbe33684db592573594f293f1cda in total
Job Failure Risk Analysis for sha: b3b85fbee427cbe33684db592573594f293f1cda
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | Medium Job run should complete before timeout This test has passed 96.58% of 4292 runs on release 4.20 [Overall] in the last week. |
@openshift-bot: This pull request explicitly references no jira issue.
In response to this:
disruptions Information
There were (
1474) added jobs and (664) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, disruptions had
674jobs increased and1750jobs decreased.Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase pod-to-host-new-connections 4.20 amd64 ovn metal compact 106 1h27m2.5s 175.67% 1h43m39.7s 102.12% host-to-host-new-connections 4.20 amd64 ovn metal compact 106 1h27m48.25s 171.07% 1h45m13.95s 80.06% pod-to-host-reused-connections 4.20 amd64 ovn metal compact 106 49m7.5s 207.51% 55m23.8s 59.67% host-to-host-reused-connections 4.20 amd64 ovn metal compact 106 51m47.5s 117.46% 59m56.65s 37.31% openshift-api-http2-localhost-new-connections 4.20 amd64 ovn metal compact 106 35m26.75s 81.00% 40m21.75s 46.12% kube-api-http1-localhost-new-connections 4.20 amd64 ovn metal compact 106 35m50.75s 76.15% 41m59.75s 54.10% openshift-api-http2-service-network-new-connections 4.20 amd64 ovn metal compact 106 20m0s 305.41% 28m8.35s 59.52% kube-api-http2-localhost-new-connections 4.20 amd64 ovn metal compact 106 35m4.25s 74.48% 40m27.55s 48.62% kube-api-http2-service-network-new-connections 4.20 amd64 ovn metal compact 106 20m9.75s 284.66% 26m36.85s 58.15% kube-api-http1-service-network-new-connections 4.20 amd64 ovn metal compact 106 19m48.5s 280.93% 28m44s 71.30% kube-api-http2-internal-lb-new-connections 4.20 amd64 ovn metal compact 106 15m10.75s 204.09% 27m58.7s 148.84% openshift-api-http2-internal-lb-new-connections 4.20 amd64 ovn metal compact 106 14m55.75s 189.89% 28m36.4s 144.40% kube-api-http1-internal-lb-new-connections 4.20 amd64 ovn metal compact 106 14m45.25s 181.03% 29m54.15s 166.12% image-registry-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m31s 39000.00% 30m53s 92550.00% ingress-to-console-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m31s 19450.00% 30m54.5s 36990.00% ingress-to-oauth-server-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m30s 38900.00% 30m55.5s 185450.00% ingress-to-console-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m30s 38900.00% 30m53.5s 185250.00% image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m31.5s 13400.00% 30m53.5s 36970.00% openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 38850.00% 30m54s 46250.00% ingress-to-oauth-server-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m30.5s 19425.00% 30m56s 37020.00% kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 38850.00% 30m54s 61700.00% oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 38850.00% 30m54s 46250.00% cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m1s 36000.00% 30m23.5s 60683.33% cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m1s 36000.00% 30m22s 45450.00% metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 6m1s 36000.00% 30m22.5s 45462.50% cache-kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 751 5m59.5s 35850.00% 30m23.5s 60683.33% openshift-api-http2-localhost-new-connections 4.19 amd64 ovn azure ha 340 4m1.15s 209.17% 4m39s 220.98% kube-api-http1-localhost-reused-connections 4.19 amd64 ovn azure ha 340 3m20.1s 207.85% 3m53.22s 211.29% service-load-balancer-with-pdb-new-connections 4.19 4.19 amd64 ovn gcp ha 751 1m53.5s 11250.00% 17m38.5s 26495.48% service-load-balancer-with-pdb-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 1m54s 3700.00% 17m39s 35200.00% kube-api-http1-internal-lb-reused-connections 4.20 amd64 ovn metal compact 106 5m10s 49.04% 12m3.15s 58.38% kube-api-http2-internal-lb-reused-connections 4.20 amd64 ovn metal compact 106 4m29.5s 34.75% 11m39.45s 32.40% ingress-to-console-reused-connections 4.20 amd64 ovn metal compact 106 15.75s 75.00% 28.9s 87.66% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 413 6.2s 520.00% 5m29.28s 4016.00% ingress-to-console-new-connections 4.20 amd64 ovn metal compact 106 7s 250.00% 20.95s 217.42% pod-to-host-new-connections 4.20 4.20 amd64 ovn aws ha 614 7.35s 145.00% 51s 58.39% ingress-to-oauth-server-reused-connections 4.20 amd64 ovn metal compact 106 15.25s 32.61% 28.65s 104.64% image-registry-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 100.00% 18m47.83s 56291.50% gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn aws ha 1188 3s 50.00% 2m6.48s 346.29% ingress-to-oauth-server-new-connections 4.20 4.20 arm64 ovn aws ha 128 2s 100.00% 4.73s 49.21% image-registry-new-connections 4.20 4.20 arm64 ovn aws ha 128 2s 100.00% 9.92s 197.01% service-load-balancer-with-pdb-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 100.00% 17m37.61s 52780.50% ingress-to-console-new-connections 4.19 4.19 arm64 ovn aws ha 114 1.35s 35.00% 10.09s 236.33% metrics-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 5m17.5s 0.00% 29m40s 177900.00% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 413 5s 0.00% 3m11.4s 3090.00% image-registry-reused-connections 4.19 4.18 amd64 ovn gcp ha 617 1s 0.00% 2s 100.00% gcp-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 525 0s 0.00% 48.04s 1342.64% ingress-to-oauth-server-new-connections 4.19 amd64 ovn gcp ha 429 0s 0.00% 4.6s 53.33% metrics-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 26.4s 780.00% image-registry-new-connections 4.19 4.19 arm64 ovn aws ha 114 1s 0.00% 4.61s 130.50% image-registry-new-connections 4.19 4.18 amd64 ovn gcp ha 617 2s 0.00% 16.04s 196.49% openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 8.95s 664.96% host-to-host-new-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 2m47s 10744.16% openshift-api-http2-localhost-reused-connections 4.19 4.18 amd64 ovn vsphere ha 108 1m10.3s 0.00% 1m37.88s 39.39% host-to-service-new-connections 4.19 arm64 ovn aws ha 325 0s 0.00% 760ms 1166.67% openshift-api-new-connections 4.19 amd64 ovn gcp ha 197 0s 0.00% 6.16s 516.00% kube-api-http2-internal-lb-reused-connections 4.19 4.18 amd64 ovn metal ha 106 21s 0.00% 42.95s 77.63% service-load-balancer-with-pdb-new-connections 4.19 4.18 amd64 ovn gcp ha 617 1s 0.00% 38.4s 1180.00% host-to-service-new-connections 4.19 4.18 amd64 ovn vsphere ha 107 4s 0.00% 2m50.44s 16944.00% cache-oauth-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 5m17s 0.00% 29m42s 178100.00% host-to-host-new-connections 4.19 4.18 amd64 ovn azure ha 589 0s 0.00% 10.12s 912.00% openshift-api-http2-internal-lb-new-connections 4.19 4.18 amd64 ovn azure ha 589 0s 0.00% 2s 100.00% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 11s 450.00% azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 371 4s 0.00% 6m14.2s 4408.43% oauth-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 0.00% 30m53.5s 185250.00% oauth-api-new-connections 4.19 4.18 amd64 ovn aws ha 699 0s 0.00% 3.94s 31.33% openshift-api-http2-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 751 5s 0.00% 7s 600.00% kube-api-http2-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 751 5s 0.00% 7s 600.00% oauth-api-reused-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 5.28s 751.61% ingress-to-console-reused-connections 4.19 4.18 amd64 ovn gcp ha 617 1s 0.00% 12.08s 1108.00% host-to-pod-new-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 2m38.16s 7503.85% kube-api-http1-service-network-reused-connections 4.19 amd64 ovn aws ha 234 0s 0.00% 670ms 509.09% ingress-to-oauth-server-new-connections 4.19 4.18 amd64 ovn gcp ha 617 1s 0.00% 31.12s 522.40% openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 15.56s 418.67% kube-api-http2-service-network-new-connections 4.19 4.18 amd64 ovn gcp ha 617 3s 0.00% 4s 33.33% pod-to-host-new-connections 4.19 amd64 ovn gcp ha 197 200ms 0.00% 18.76s 5762.50% cache-openshift-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 5m12.5s 0.00% 29m38s 177700.00% ingress-to-console-reused-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 2s 100.00% kube-api-new-connections 4.19 amd64 ovn rosa external 102 0s 0.00% 1s 455.56% openshift-api-http2-localhost-new-connections 4.19 4.18 amd64 ovn vsphere ha 108 1m10.3s 0.00% 1m36.95s 38.52% host-to-service-new-connections 4.19 heterogeneous ovn aws ha 525 0s 0.00% 1s 203.03% host-to-pod-reused-connections 4.19 amd64 ovn metal compact 130 7.55s 0.00% 4m25.18s 112.69% host-to-host-new-connections 4.19 amd64 ovn gcp ha 197 1s 0.00% 19.16s 95700.00% ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 371 0s 0.00% 5.3s 430.00% cache-openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 13.56s 462.66% oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 7s 422.39% host-to-service-new-connections 4.19 amd64 ovn vsphere ha 669 0s 0.00% 30.64s 2370.97% ingress-to-console-new-connections 4.19 4.18 amd64 ovn vsphere ha 108 0s 0.00% 8.72s 3691.30% cache-kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 11.2s 273.33% gcp-network-liveness-new-connections 4.19 amd64 ovn gcp ha 429 1s 0.00% 3m34.2s 90.37% gcp-network-liveness-new-connections 4.19 arm64 ovn aws ha 167 700ms 0.00% 59.28s 3514.63% kube-api-http2-internal-lb-reused-connections 4.19 amd64 ovn aws ha 892 10s 0.00% 21s 107.72% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn metal ha 317 0s 0.00% 9.88s 951.06% gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 371 5s 0.00% 4m17.3s 4945.10% kube-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 0.00% 30m54s 185300.00% azure-network-liveness-new-connections 4.19 amd64 ovn azure ha 342 0s 0.00% 22.21s 45.35% pod-to-pod-reused-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 2m37.88s 21827.78% kube-api-http2-service-network-reused-connections 4.19 amd64 ovn azure ha 196 0s 0.00% 7.35s 665.62% kube-api-http1-internal-lb-new-connections 4.19 4.19 amd64 ovn gcp ha 751 5s 0.00% 7s 600.00% cache-oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 18.76s 525.33% metrics-api-new-connections 4.19 amd64 ovn gcp ha 429 0s 0.00% 5.72s 146.55% oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 16.24s 573.86% ingress-to-console-new-connections 4.19 4.18 amd64 ovn gcp ha 617 1s 0.00% 30.28s 657.00% azure-network-liveness-new-connections 4.19 amd64 ovn gcp ha 429 0s 0.00% 5m23.16s 71.88% oauth-api-new-connections 4.19 amd64 ovn rosa external 102 0s 0.00% 1s 455.56% openshift-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 6m29.5s 0.00% 30m54s 185300.00% kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 7s 600.00% service-load-balancer-with-pdb-new-connections 4.19 amd64 ovn rosa ha 104 0s 0.00% 970ms 708.33% host-to-pod-new-connections 4.19 amd64 ovn metal compact 130 5.1s 0.00% 4m45.58s 125.93% metrics-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 36.6s 3560.00% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn rosa ha 106 0s 0.00% 57.1s 47483.33% cache-openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 936 0s 0.00% 6.65s 565.00% pod-to-service-new-connections 4.19 amd64 ovn gcp ha 197 200ms 0.00% 3.04s 204.00% service-load-balancer-with-pdb-new-connections 4.19 amd64 ovn gcp ha 197 2s 0.00% 3s 200.00% kube-api-http2-service-network-reused-connections 4.19 4.18 amd64 ovn vsphere ha 108 0s 0.00% 930ms 304.35% gcp-network-liveness-new-connections 4.19 amd64 ovn azure ha 196 250ms 0.00% 1m59.65s 1275.29% ingress-to-console-reused-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 3s 50.00% ingress-to-console-reused-connections 4.19 4.19 arm64 ovn aws ha 114 0s 0.00% 7.22s 622.00% metrics-api-new-connections 4.19 amd64 ovn vsphere ha 673 0s 0.00% 25.28s 321.33% azure-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 525 0s 0.00% 1m39.52s 2203.70% ingress-to-oauth-server-new-connections 4.19 arm64 ovn aws ha 167 700ms 0.00% 13.7s 1123.21% image-registry-reused-connections 4.19 4.18 amd64 ovn aws ha 699 0s 0.00% 1s 66.67% cache-kube-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 751 5m15.5s 0.00% 29m38s 177700.00% openshift-api-http2-localhost-new-connections 4.19 amd64 ovn metal compact 130 7m22.15s 0.00% 16m49.29s 30.49% ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws ha 896 0s 0.00% 5.2s 420.00% kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 617 0s 0.00% 12.2s 306.67% kube-api-new-connections 4.19 amd64 ovn gcp ha 197 0s 0.00% 9.04s 804.00% host-to-pod-new-connections 4.19 amd64 ovn gcp ha 197 0s 0.00% 1.12s 250.00% ci-cluster-network-liveness-new-connections 4.19 arm64 ovn aws ha 167 0s 0.00% 11s 3337.50% openshift-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 0.00% 5s 400.00% ingress-to-console-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 0.00% 18m47.83s 37494.33% kube-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m40s 111900.00% openshift-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m39.87s 111887.00% openshift-api-reused-connections 4.20 4.20 arm64 ovn aws ha 128 1s 0.00% 3.73s 86.50% kube-api-http2-internal-lb-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m39.87s 27896.75% ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m47.83s 32496.24% metrics-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m9.61s 36220.33% openshift-api-http2-internal-lb-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% kube-api-http1-service-network-reused-connections 4.20 4.20 arm64 ovn aws ha 128 1s 0.00% 2s 100.00% azure-network-liveness-reused-connections 4.20 4.20 arm64 ovn aws ha 128 0s 0.00% 11.49s 882.05% openshift-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% kube-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn aws ha 1188 0s 0.00% 2s 100.00% kube-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 0.00% 5s 400.00% image-registry-reused-connections 4.20 4.20 amd64 ovn aws ha 614 0s 0.00% 1.87s 87.00% kube-api-http1-internal-lb-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% metrics-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 5.79s 479.00% openshift-api-http2-service-network-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2s 100.00% cache-oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m9.87s 36229.00% kube-api-http2-service-network-reused-connections 4.20 4.20 arm64 ovn aws ha 128 1s 0.00% 2.73s 173.00% image-registry-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 0.00% 18m47.83s 28095.75% cache-kube-api-reused-connections 4.20 4.20 amd64 ovn azure ha 577 2s 0.00% 3s 50.00% kube-api-http1-service-network-reused-connections 4.20 4.19 amd64 ovn aws ha 1188 0s 0.00% 2s 100.00% kube-api-reused-connections 4.20 4.20 arm64 ovn aws ha 128 0s 0.00% 2.92s 1617.65% ingress-to-console-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2.62s 162.00% oauth-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m39.87s 111887.00% kube-api-http2-internal-lb-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2s 100.00% ingress-to-oauth-server-new-connections 4.20 heterogeneous ovn aws ha 270 0s 0.00% 2s 100.00% openshift-api-http2-service-network-reused-connections 4.20 heterogeneous ovn aws ha 270 0s 0.00% 1s 156.41% openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m39.87s 37229.00% oauth-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 6.41s 541.00% ingress-to-console-new-connections 4.20 heterogeneous ovn aws ha 270 550ms 0.00% 2s 100.00% kube-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 18.24s 508.00% metrics-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 15.48s 674.00% ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 0s 0.00% 16s 45.45% ci-cluster-network-liveness-new-connections 4.20 4.20 arm64 ovn aws ha 128 0s 0.00% 1.73s 917.65% cache-oauth-api-reused-connections 4.20 4.20 amd64 ovn azure ha 577 2s 0.00% 3s 50.00% openshift-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn aws ha 1188 0s 0.00% 2s 100.00% kube-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 3.62s 262.00% openshift-api-http2-service-network-reused-connections 4.20 4.20 amd64 ovn aws ha 613 1s 0.00% 2s 100.00% kube-api-http1-service-network-reused-connections 4.20 4.20 amd64 ovn aws ha 613 0s 0.00% 2.88s 188.00% openshift-api-reused-connections 4.20 heterogeneous ovn aws ha 270 1s 0.00% 1.31s 31.00% cache-kube-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 17.86s 779.80% cache-openshift-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 17m25.61s 104461.00% kube-api-http2-service-network-reused-connections 4.20 4.20 amd64 ovn aws ha 613 1s 0.00% 2s 100.00% openshift-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 3.93s 293.00% ingress-to-oauth-server-new-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 13.55s 236.23% pod-to-service-reused-connections 4.20 4.20 amd64 ovn aws single 519 5s 0.00% 9s 80.00% cache-kube-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 3s 200.00% cache-kube-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 17m25.61s 104461.00% service-load-balancer-with-pdb-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 3s 0.00% 17m36.74s 35124.67% ingress-to-console-new-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 13.55s 171.00% kube-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% cache-kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m10.35s 54417.50% oauth-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 19.55s 551.67% cache-oauth-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1.35s 0.00% 17m27.74s 104674.00% pod-to-service-new-connections 4.20 4.20 amd64 ovn aws single 519 5s 0.00% 9s 80.00% ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn aws single 519 1s 0.00% 1m18.12s 388.25% cache-openshift-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 3s 200.00% image-registry-new-connections 4.20 heterogeneous ovn aws ha 270 0s 0.00% 3.24s 224.00% cache-openshift-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 18.24s 508.00% kube-api-http1-service-network-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% azure-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1101 0s 0.00% 48s 134.60% ingress-to-console-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m47.83s 112683.00% kube-api-http1-internal-lb-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2s 100.00% kube-api-http1-service-network-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2.87s 187.00% openshift-api-http2-service-network-reused-connections 4.20 4.20 arm64 ovn aws ha 128 1s 0.00% 3s 200.00% image-registry-new-connections 4.20 4.19 amd64 ovn gcp ha 670 2s 0.00% 17s 237.97% ingress-to-oauth-server-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m47.96s 112696.00% kube-api-http1-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 1.31s 4266.67% cache-oauth-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 17.55s 485.00% kube-api-http1-service-network-reused-connections 4.20 4.20 amd64 ovn azure ha 577 1s 0.00% 2s 100.00% openshift-api-new-connections 4.20 4.19 amd64 ovn gcp ha 670 0s 0.00% 17.55s 777.50% ingress-to-oauth-server-reused-connections 4.20 4.20 amd64 ovn aws ha 614 0s 0.00% 2.87s 187.00% openshift-api-http2-internal-lb-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2s 100.00% service-load-balancer-with-pdb-new-connections 4.20 heterogeneous ovn aws ha 270 0s 0.00% 3.31s 136.43% kube-api-http2-service-network-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 2s 100.00% kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m39.87s 45423.17% cache-oauth-api-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 3s 200.00% metrics-api-reused-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 17m27.96s 104696.00% cache-openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 1s 0.00% 18m10.61s 54430.50% kube-api-http1-internal-lb-new-connections 4.20 4.20 amd64 ovn gcp ha 1214 2s 0.00% 5s 400.00% ci-cluster-network-liveness-new-connections 4.20 heterogeneous ovn aws ha 270 0s 0.00% 2s 163.16% ingress-to-oauth-server-reused-connections 4.20 4.19 amd64 ovn gcp ha 670 1s 0.00% 2s 100.00% alerts Information
There were (
13658) added jobs and (3970) were removed.Comparisons were above allowed leeway of
30.00%Note: For P99, alerts had
29jobs increased and538jobs decreased./cc @dgoodwin, @neisw, @DennisPeriquetClick To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase KubeJobFailed openshift-insights Warning 4.19 arm64 ovn aws ha 120 2h20m27.8s 259.07% 6h18m48.6s 79.19% KubeJobFailed openshift-insights Warning 4.20 arm64 ovn aws ha 158 2h55m23.2s 31.39% 6h33m0.18s 175.03% TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning 4.20 amd64 ovn metal ha 271 1h44m5s 51.25% 1h55m50.8s 52.86% TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning 4.19 amd64 ovn metal ha 362 1h39m17.4s 43.07% 1h49m53.74s 49.61% KubeletPlegDurationHigh kube-system Warning 4.20 4.20 amd64 ovn gcp ha 290 3m28s 40.54% 5m28s 37.82% KubeletPlegDurationHigh kube-system Warning 4.20 amd64 ovn azure ha 125 22.4s 0.00% 2m28s 183.52% KubeletPlegDurationHigh kube-system Warning 4.20 4.20 amd64 ovn azure ha 183 0s 0.00% 2m33.4s 447.86% AlertmanagerReceiversNotConfigured openshift-monitoring Warning 4.20 arm64 ovn aws ha 158 3h36m40.4s 0.00% 3h51m8.6s 31.53% TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning 4.20 arm64 ovn aws ha 158 3h36m40.4s 0.00% 3h51m8.6s 31.53% KubeletPlegDurationHigh kube-system Warning 4.20 4.19 amd64 ovn gcp ha 176 0s 0.00% 3m13s 8516.07%
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.
Job Failure Risk Analysis for sha: c8cff43f4bc0ede5fbc1607df3707a9fd07decbe
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-disruptive | Medium [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling | Low [bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available This test has passed 69.83% of 5440 runs on release 4.20 [Overall] in the last week. Open Bugs [CI] e2e-openstack-ovn-etcd-scaling job permanent fails at many openshift-test tests --- [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | Medium Job run should complete before timeout This test has passed 96.68% of 4305 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis |
Job Failure Risk Analysis for sha: abe1efbcc9c2b748e4759245e915d1c845395075
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | Medium Job run should complete before timeout This test has passed 94.18% of 3849 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | Medium [bz-Etcd] clusteroperator/etcd should not change condition/Available Potential external regression detected for High Risk Test analysis |
@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:
| Test name | Commit | Details | Required | Rerun command |
|---|---|---|---|---|
| ci/prow/e2e-aws-ovn-serial-publicnet | 20605d1dee517c40f18f533227bdaa6a162fcb54 | link | false | /test e2e-aws-ovn-serial-publicnet |
| ci/prow/e2e-metal-ipi-serial-ovn-ipv6 | 20605d1dee517c40f18f533227bdaa6a162fcb54 | link | false | /test e2e-metal-ipi-serial-ovn-ipv6 |
| ci/prow/e2e-metal-ipi-serial | 20605d1dee517c40f18f533227bdaa6a162fcb54 | link | false | /test e2e-metal-ipi-serial |
| ci/prow/e2e-gcp-fips-serial | 20605d1dee517c40f18f533227bdaa6a162fcb54 | link | false | /test e2e-gcp-fips-serial |
| ci/prow/4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | 063fb8a028e6b119db308136045b87488187d527 | link | false | /test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback |
| ci/prow/e2e-aws-ovn-serial-publicnet-1of2 | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn-serial-publicnet-1of2 |
| ci/prow/e2e-openstack-ovn | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-openstack-ovn |
| ci/prow/e2e-aws-ovn-single-node-upgrade | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn-single-node-upgrade |
| ci/prow/e2e-vsphere-ovn-etcd-scaling | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-vsphere-ovn-etcd-scaling |
| ci/prow/e2e-aws-ovn-microshift | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn-microshift |
| ci/prow/e2e-gcp-ovn-etcd-scaling | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-gcp-ovn-etcd-scaling |
| ci/prow/e2e-azure-ovn-upgrade | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-azure-ovn-upgrade |
| ci/prow/e2e-hypershift-conformance | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-hypershift-conformance |
| ci/prow/e2e-aws-disruptive | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-disruptive |
| ci/prow/okd-scos-e2e-aws-ovn | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test okd-scos-e2e-aws-ovn |
| ci/prow/e2e-aws-ovn-etcd-scaling | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn-etcd-scaling |
| ci/prow/e2e-gcp-fips-serial-1of2 | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-gcp-fips-serial-1of2 |
| ci/prow/e2e-azure-ovn-etcd-scaling | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-azure-ovn-etcd-scaling |
| ci/prow/e2e-gcp-fips-serial-2of2 | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-gcp-fips-serial-2of2 |
| ci/prow/e2e-aws-ovn | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn |
| ci/prow/e2e-gcp-disruptive | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-gcp-disruptive |
| ci/prow/e2e-openstack-serial | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-openstack-serial |
| ci/prow/e2e-metal-ipi-serial-2of2 | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-metal-ipi-serial-2of2 |
| ci/prow/e2e-aws-ovn-microshift-serial | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-aws-ovn-microshift-serial |
| ci/prow/okd-e2e-gcp | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test okd-e2e-gcp |
| ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-metal-ipi-ovn-kube-apiserver-rollout |
| ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 | 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe | link | false | /test e2e-vsphere-ovn-dualstack-primaryv6 |
Full PR test history. Your PR dashboard.
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: neisw, openshift-bot
The full list of commands accepted by this bot can be found here.
The pull request process is described here
- ~~OWNERS~~ [neisw]
Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment
/retest-required
Remaining retests: 0 against base HEAD af0e85d21e1c8f02c7c0272b4a7e6f0d6f9db314 and 2 for PR HEAD 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe in total
Job Failure Risk Analysis for sha: 38c0b457d734315c0b4e4f94a2bbc1cae8bc24fe
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Low [sig-api-machinery] disruption/kube-api apiserver/kube-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time --- [bz-etcd][invariant] alert/etcdMembersDown should not be at or above info This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time --- [sig-api-machinery] disruption/oauth-api apiserver/oauth-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- Showing 4 of 5 test results |
[ART PR BUILD NOTIFIER]
Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.20.0-202507230155.p0.g47eed7a.assembly.stream.el9. All builds following this will include this PR.