origin
origin copied to clipboard
openshift
OCPBUGS-56281: gatewayapicontroller: Clean up resources when done
gatewayapicontroller: Add checks for empty slices
Check whether the slice of parent resource references in an httproute's status is empty before indexing the slice.
Before this commit, the "Ensure HTTPRoute object is created" test sometimes panicked with "runtime error: index out of range [0] with length 0".
Similarly, check whether the slice of load-balancer ingress points in a service's status is empty before indexing it.
gatewayapicontroller: Clean up resources when done
Delete the gatewayclass and uninstall OSSM after all the Gateway API controller tests are done.
Before this change, the Gateway API controller tests left OSSM installed, including the subscription, CSV, installplan, bundled CRDs, RBAC resources, deployment, service, serviceaccount, etc., when the tests were finished. This clutter could cause problems for other tests, or for the same test if it was run again.
The new cleanup logic uses the OperatorsV1 client from github.com/operator-framework/operator-lifecycle-manager. Importing this package requires a replace stanza for openshift/api in go.mod.
This vendors github.com/operator-framework/operator-lifecycle-manager v0.30.1-0.20250114164243-1b6752ec65fa rather than the newest revision in order to avoid bringing in additional problematic vendor bumps that the newest revision would bring in.
gatewayapicontroller: Always log errors
Add the error value to some log messages that were missing it.
@Miciah: This pull request references Jira Issue OCPBUGS-56281, which is invalid:
- expected the bug to target the "4.20.0" version, but no target version was set
Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.
The bug has been updated to refer to the pull request using the external bug tracker.
In response to this:
gatewayapicontroller: Add checks for empty slices
Check whether the slice of parent resource references in an httproute's status is empty before indexing the slice.
Before this commit, the "Ensure HTTPRoute object is created" test sometimes panicked with "runtime error: index out of range [0] with length 0".
Similarly, check whether the slice of load-balancer ingress points in a service's status is empty before indexing it.
gatewayapicontroller: Clean up resources when done
Delete the gatewayclass and uninstall OSSM after all the Gateway API controller tests are done.
Before this change, the Gateway API controller tests left OSSM installed, including the subscription, CSV, installplan, bundled CRDs, RBAC resources, deployment, service, serviceaccount, etc., when the tests were finished. This clutter could cause problems for other tests, or for the same test if it was run again.
The new cleanup logic uses the
OperatorsV1client fromgithub.com/operator-framework/operator-lifecycle-manager. Importing this package requires areplacestanza foropenshift/apiingo.mod.This vendors
github.com/operator-framework/operator-lifecycle-manager v0.30.1-0.20250114164243-1b6752ec65farather than the newest revision in order to avoid bringing in additional problematic vendor bumps that the newest revision would bring in.gatewayapicontroller: Always log errors
Add the error value to some log messages that were missing it.
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.
Job Failure Risk Analysis for sha: bf853bfc3dd708ca0d49cde609506a319c439f28
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | IncompleteTests Tests for this run (19) are below the historical average (1505): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial-1of2 | IncompleteTests Tests for this run (19) are below the historical average (1822): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout | IncompleteTests Tests for this run (29) are below the historical average (1778): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
![openshift-trt[bot] avatar](https://avatars.githubusercontent.com/u/111778100?v=4 "Published by a pub.dev verified publisher"){kind=small}
Job Failure Risk Analysis for sha: 1967dd22c83963e780eb9953bc38da760e090dc8
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | IncompleteTests Tests for this run (94) are below the historical average (209): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones | High [sig-network-edge][OCPFeatureGate:GatewayAPIController][Feature:Router][apigroup:gateway.networking.k8s.io] Ensure custom gatewayclass can be accepted [Suite:openshift/conformance/parallel] This test has passed 98.38% of 2463 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | IncompleteTests Tests for this run (196) are below the historical average (3374): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling | Low [bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs [CI] e2e-openstack-ovn-etcd-scaling job permanent fails at many openshift-test tests etcd-scaling jobs failing ~60% of the time --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Medium [sig-instrumentation] disruption/metrics-api connection/new should be available throughout the test Potential external regression detected for High Risk Test analysis |
Job Failure Risk Analysis for sha: ab81b79529fdd7fcb39a911830ef239a86d115bc
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback | MissingData |
| pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones | High [sig-network-edge][OCPFeatureGate:GatewayAPIController][Feature:Router][apigroup:gateway.networking.k8s.io] Ensure custom gatewayclass can be accepted [Suite:openshift/conformance/parallel] This test has passed 99.76% of 2503 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | IncompleteTests Tests for this run (2125) are below the historical average (3401): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
https://github.com/openshift/origin/compare/1967dd22c83963e780eb9953bc38da760e090dc8..1dcc98a3c2ec7c38dcee818e750e14ce57d70892 made these changes:
- Add logic to delete the Istio CR in the test cleanup.
- Declare package consts for
istioNameandingressNamespaceand use these instead of function-local variables and string literals. - Omit the namespace when getting the Istio CR, which is cluster-scoped.
Before these changes, pods.json from e2e-aws #1932229162710339584 had the istiod pod. After these changes, pods.json from e2e-aws #1933552902287134720 does not have the istiod pod. It appears that the istiod pod cleanup is working properly.
Also, comparing must-gather.tar from 1933552902287134720 and must-gather.tar from 1932229162710339584, the older must-gather archive has the istiorevisions.sailoperator.io.yaml CRD whereas the newer must-gather archive does not. Neither must-gather archive has any other istio.io or sailoperator.io CRDs. I believe that deleting the Istio CR enables the cleanup to delete all OSSM-installed CRDs successfully.
Job Failure Risk Analysis for sha: 1dcc98a3c2ec7c38dcee818e750e14ce57d70892
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn | High [sig-network-edge][OCPFeatureGate:GatewayAPIController][Feature:Router][apigroup:gateway.networking.k8s.io] Ensure HTTPRoute object is created [Suite:openshift/conformance/parallel] This test has passed 99.22% of 2451 runs on release 4.20 [Overall] in the last week. Open Bugs Component Readiness: [Networking / router] [OCPFeatureGate:GatewayAPIController] test regressed on HyperShift Azure AKS |
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time |
| pull-ci-openshift-origin-main-e2e-aws-ovn-microshift | High [sig-api-machinery] API priority and fairness should ensure that requests can be classified by adding FlowSchema and PriorityLevelConfiguration [Suite:openshift/conformance/parallel] [Suite:k8s] This test has passed 99.97% of 3060 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | IncompleteTests Tests for this run (2125) are below the historical average (3318): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-rt-upgrade | IncompleteTests Tests for this run (19) are below the historical average (1620): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs etcd-scaling jobs failing ~60% of the time --- [sig-api-machinery] disruption/cache-openshift-api apiserver/openshift-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [sig-api-machinery] disruption/cache-oauth-api apiserver/oauth-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. |
/payload-aggregate periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade 5
@abhat: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/101e8ee0-4acb-11f0-928a-4bd1c2be89d0-0
![openshift-ci[bot] avatar](https://avatars.githubusercontent.com/in/91280?v=4 "Published by a pub.dev verified publisher"){kind=small}
Job Failure Risk Analysis for sha: 38d8018dfd320088688bd559b77c7f73e998ef13
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-gcp-csi | IncompleteTests Tests for this run (19) are below the historical average (1374): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | IncompleteTests Tests for this run (19) are below the historical average (1140): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial-1of2 | IncompleteTests Tests for this run (18) are below the historical average (1403): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-fips-serial-2of2 | IncompleteTests Tests for this run (19) are below the historical average (1430): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn | IncompleteTests Tests for this run (19) are below the historical average (1146): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling | IncompleteTests Tests for this run (19) are below the historical average (1343): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-rt-upgrade | IncompleteTests Tests for this run (19) are below the historical average (1315): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade | IncompleteTests Tests for this run (19) are below the historical average (810): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
The aggregated jobs each failed while buliding the tests-openshift.origin-amd64 image, with the error message, "Error: Unable to find a match: python3-cinderclient" (missing RPM package). I'll retry in case it was glitch with the Yum repository.
/payload-aggregate periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade 5
@Miciah: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/aad73360-4cbf-11f0-9efa-6a57a5235fed-0
This time all the aggregated jobs failed to build the image with the erorr message, "Error: Unable to find a match: realtime-tests rteval".
/payload-aggregate periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade 5
@Miciah: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/c0124e40-4d46-11f0-9623-e230cc269dc8-0
This time all the aggregated jobs failed with, "Error: Unable to find a match: python3-cinderclient realtime-tests rteval". I have filed OCPBUGS-57921 for these failures.
/payload-aggregate periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade 5
@Miciah: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.19-upgrade-from-stable-4.18-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7029ee70-4e03-11f0-8a1d-a44ec557b951-0
/payload-aggregate periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade 5
bumping the job up to 4.20 minor upgrade since this is against main
@neisw: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/47156fb0-5776-11f0-9554-6cf09318630a-0
https://github.com/openshift/origin/compare/38d8018dfd320088688bd559b77c7f73e998ef13..e2271274f2b3f34c7eff8ffa252520acb593cacc rebases and adds a code comment to resolve https://github.com/openshift/origin/pull/29900#discussion_r2150992281.
Job Failure Risk Analysis for sha: e2271274f2b3f34c7eff8ffa252520acb593cacc
| Job Name | Failure Risk |
|---|---|
| pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week. |
| pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling | Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week. Open Bugs [CI] e2e-openstack-ovn-etcd-scaling job permanent fails at many openshift-test tests |
| pull-ci-openshift-origin-main-e2e-azure-ovn-upgrade | Medium Job run should complete before timeout This test has passed 81.98% of 3912 runs on release 4.20 [Overall] in the last week. |
| pull-ci-openshift-origin-main-e2e-gcp-disruptive | IncompleteTests Tests for this run (31) are below the historical average (1031): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems) |
| pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling | Low [sig-api-machinery] disruption/oauth-api apiserver/oauth-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [sig-api-machinery] disruption/cache-openshift-api apiserver/openshift-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. --- [sig-api-machinery] disruption/cache-oauth-api apiserver/oauth-apiserver connection/new should be available throughout the test This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:vsphere SecurityMode:default Topology:ha Upgrade:none] in the last week. |
/payload-aggregate periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade 5
@Miciah: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/01735eb0-63f9-11f0-8a51-969494547845-0
The aggregator job failed with the following error:
* 2025-07-18T17:05:06Z 1x ovnk-controlplane: failed to add remote pod ci-op-zqhb342w/release-analysis-prpqr-aggregator-openshift-release-analysis-prpqr-aggregator to namespace: failed to ensure namespace locked: failed to create address set for namespace: ci-op-zqhb342w, error: error in transact with ops [{Op:insert Table:Address_Set Row:map[addresses:{GoSet:[10.129.28.12]} external_ids:{GoMap:map[ip-family:v4 k8s.ovn.org/id:default-network-controller:Namespace:ci-op-zqhb342w:v4 k8s.ovn.org/name:ci-op-zqhb342w k8s.ovn.org/owner-controller:default-network-controller k8s.ovn.org/owner-type:Namespace]} name:a4896564910794585983] Rows:[] Columns:[] Mutations:[] Timeout:<nil> Where:[] Until: Durable:<nil> Comment:<nil> Lock:<nil> UUID: UUIDName:u1843546273}] results [{Count:0 Error: Details: UUID:{GoUUID:fffabfdd-7d5e-443f-9016-87408452fce5} Rows:[]} {Count:0 Error:constraint violation Details:Transaction causes multiple rows in "Address_Set" table to have identical values (a4896564910794585983) for index on column "name". First row, with UUID fffabfdd-7d5e-443f-9016-87408452fce5, was inserted by this transaction. Second row, with UUID 3a03cf9a-9a02-4a87-a6c9-9b7b141c3fee, existed in the database before this transaction and was not modified by the transaction. UUID:{GoUUID:} Rows:[]}] and errors []: constraint violation: Transaction causes multiple rows in "Address_Set" table to have identical values (a4896564910794585983) for index on column "name". First row, with UUID fffabfdd-7d5e-443f-9016-87408452fce5, was inserted by this transaction. Second row, with UUID 3a03cf9a-9a02-4a87-a6c9-9b7b141c3fee, existed in the database before this transaction and was not modified by the transaction.
I can't find any other recent reports of 'Transaction causes multiple rows in "Address_Set" table to have identical values' errors, so maybe it was a fluke.
/payload-aggregate periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade 5
@Miciah: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
- periodic-ci-openshift-release-master-ci-4.20-upgrade-from-stable-4.19-e2e-gcp-ovn-rt-upgrade
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/71d0d090-6410-11f0-96c5-c864058ace3c-0