origin icon indicating copy to clipboard operation
origin copied to clipboard
verified publisher icon openshift

WRKLDS-1431: e2e: migrate DCs to Deployments

Open ingvagabund opened this issue 1 year ago • 42 comments

Migrated:

  • [Serial] [sig-auth][Feature:OAuthServer] [RequestHeaders] [IdP] test RequestHeaders IdP [apigroup:config.openshift.io][apigroup:user.openshift.io]: works without DC API enabled
  • [sig-builds][Feature:Builds][volumes] ...: migrating with triggers
  • [sig-cli] oc --request-timeout works as expected: creating a deployment instead of a DC
  • [sig-cli] oc adm build-chain [apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io]: migrating with triggers
  • [sig-cli] oc builds ...: migrating with triggers
  • [sig-cli] oc debug ensure debug does not depend on a container actually existing for the selected resource: duplicating for deployments
  • [sig-cli] oc env can set environment variables: migrating with triggers
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments
  • [sig-cli] oc run can use --image flag correctly: creating a deployment instead of a DC
  • [sig-cli] oc set image can set images for pods and deployments: migrating with triggers
  • [sig-cli] oc status returns expected help messages: works without DC as long as --suggest arg is provided
  • [sig-cli] templates process: migrating with triggers
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on:
  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced: 
     [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------
    IDENTIFIER was removed by https://github.com/openshift/origin/pull/26072.
  • [sig-scalability]: can't find any run in https://search.dptools.openshift.org/?search=%5C%5Bsig-scalability%5C%5D&maxAge=48h&context=1&type=junit&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job

ingvagabund avatar Jul 28 '24 12:07 ingvagabund

Job Failure Risk Analysis for sha: e5d212affcd152ebf83dc615a259b5017aa1f506

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Low
[sig-network] pods should successfully create sandboxes by other
This test has passed 76.35% of 5416 runs on release 4.17 [Overall] in the last week.

openshift-trt-bot avatar Jul 28 '24 23:07 openshift-trt-bot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 29 '24 11:07 openshift-ci-robot

Job Failure Risk Analysis for sha: a478e094273e36f46e12892a8891f0d7f7ca8529

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade High
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.63% of 1357 runs on release 4.17 [Overall] in the last week.
---
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.41% of 1357 runs on release 4.17 [Overall] in the last week.

openshift-trt-bot avatar Jul 29 '24 13:07 openshift-trt-bot

Job Failure Risk Analysis for sha: 6c08ffac6699971168a8643223965f185e8ef931

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-openstack-ovn High
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.36% of 1399 runs on release 4.17 [Overall] in the last week.
---
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.57% of 1399 runs on release 4.17 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn High
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.36% of 1399 runs on release 4.17 [Overall] in the last week.
---
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.57% of 1399 runs on release 4.17 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-gcp-ovn High
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 10 runs on jobs ['periodic-ci-openshift-release-master-ci-4.17-e2e-gcp-ovn'] in the last 14 days.
---
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 10 runs on jobs ['periodic-ci-openshift-release-master-ci-4.17-e2e-gcp-ovn'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade High
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.36% of 1399 runs on release 4.17 [Overall] in the last week.
---
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 99.57% of 1399 runs on release 4.17 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node High
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 15 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-single-node'] in the last 14 days.
---
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 15 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-single-node'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-fips High
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 11 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-fips'] in the last 14 days.
---
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 100.00% of 11 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-fips'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones Medium
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 92.50% of 40 runs on release 4.17 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.
---
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 92.50% of 40 runs on release 4.17 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2 Medium
[sig-cli] oc builds complex build start-build [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 92.50% of 40 runs on release 4.17 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.
---
[sig-cli] oc builds complex build webhooks CRUD [apigroup:build.openshift.io][apigroup:apps.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
This test has passed 92.50% of 40 runs on release 4.17 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.

openshift-trt-bot avatar Jul 30 '24 00:07 openshift-trt-bot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 08:07 openshift-ci-robot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced:
 [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 11:07 openshift-ci-robot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced:
 [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------

IDENTIFIER was removed by https://github.com/openshift/origin/pull/26072.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 11:07 openshift-ci-robot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced:
 [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------

IDENTIFIER was removed by https://github.com/openshift/origin/pull/26072.

  • [sig-scalability]: can't find any run in https://search.dptools.openshift.org/?search=%5C%5Bsig-scalability%5C%5D&maxAge=48h&context=1&type=junit&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 11:07 openshift-ci-robot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [Serial] [sig-auth][Feature:OAuthServer] [RequestHeaders] [IdP] test RequestHeaders IdP [apigroup:config.openshift.io][apigroup:user.openshift.io]: works without DC API enabled
  • [sig-builds][Feature:Builds][volumes] ...: migrating with triggers
  • [sig-cli] oc --request-timeout works as expected: creating a deployment instead of a DC
  • [sig-cli] oc adm build-chain [apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io]: migrating with triggers
  • [sig-cli] oc builds ...: migrating with triggers
  • [sig-cli] oc debug ensure debug does not depend on a container actually existing for the selected resource: duplicating for deployments
  • [sig-cli] oc env can set environment variables: migrating with triggers
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments
  • [sig-cli] oc run can use --image flag correctly:
  • [sig-cli] oc set image can set images for pods and deployments:
  • [sig-cli] oc status returns expected help messages:
  • [sig-cli] templates process:
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on:
  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced:
 [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------

IDENTIFIER was removed by https://github.com/openshift/origin/pull/26072.

  • [sig-scalability]: can't find any run in https://search.dptools.openshift.org/?search=%5C%5Bsig-scalability%5C%5D&maxAge=48h&context=1&type=junit&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 11:07 openshift-ci-robot

@ingvagabund: This pull request references WRKLDS-1431 which is a valid jira issue.

In response to this:

Migrated:

  • [Serial] [sig-auth][Feature:OAuthServer] [RequestHeaders] [IdP] test RequestHeaders IdP [apigroup:config.openshift.io][apigroup:user.openshift.io]: works without DC API enabled
  • [sig-builds][Feature:Builds][volumes] ...: migrating with triggers
  • [sig-cli] oc --request-timeout works as expected: creating a deployment instead of a DC
  • [sig-cli] oc adm build-chain [apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io]: migrating with triggers
  • [sig-cli] oc builds ...: migrating with triggers
  • [sig-cli] oc debug ensure debug does not depend on a container actually existing for the selected resource: duplicating for deployments
  • [sig-cli] oc env can set environment variables: migrating with triggers
  • [sig-cli] oc idle [apigroup:apps.openshift.io][apigroup:route.openshift.io][apigroup:project.openshift.io][apigroup:image.openshift.io] by ...: duplicated and changed for deployments
  • [sig-cli] oc run can use --image flag correctly: creating a deployment instead of a DC
  • [sig-cli] oc set image can set images for pods and deployments: migrating with triggers
  • [sig-cli] oc status returns expected help messages: works without DC as long as --suggest arg is provided
  • [sig-cli] templates process: migrating with triggers
  • [sig-devex][Feature:Templates] templateinstance readiness test : migrating with triggers
  • [sig-devex][Feature:ImageEcosystem][perl][Slow] hot deploy for openshift perl image hot deploy test should work [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:build.openshift.io][apigroup:apps.openshift.io]: migrating with triggers + replacing all the waiting code and Deployment -> RS -> pod retrival code.
  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on:
  • [sig-network-edge][Feature:Idling] Unidling ...: simple DC replacement (no triggers)
  • [sig-scheduling][Early] The openshift-apiserver pods [apigroup:apps.openshift.io][apigroup:authorization.openshift.io][apigroup:build.openshift.io][apigroup:image.openshift.io][apigroup:project.openshift.io][apigroup:quota.openshift.io][apigroup:route.openshift.io][apigroup:security.openshift.io][apigroup:template.openshift.io] should be scheduled on different nodes: already without DC dependency, just removing the apigroup.

Ignoring:

  • [sig-imageregistry][Feature:ImageLookup] Image policy should update OpenShift object image fields when local names are on [apigroup:image.openshift.io][apigroup:apps.openshift.io]: testing DCs
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should delete orphaned blobs [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-imageregistry][Feature:ImagePrune][Serial][Suite:openshift/registry/serial][Local] Image hard prune [apigroup:apps.openshift.io][apigroup:user.openshift.io] should show orphaned blob deletions in dry-run mode [apigroup:image.openshift.io]: not running at all, fails on missing dc/docker-registry.
  • [sig-devex][Feature:ImageEcosystem][mariadb][Slow] openshift mariadb image Creating from a template should instantiate the template [apigroup:image.openshift.io][apigroup:operator.openshift.io][apigroup:config.openshift.io][apigroup:apps.openshift.io]: broken
  • [sig-devex][Feature:ImageEcosystem][mysql][Slow] openshift mysql image Creating from a template should instantiate the template [apigroup:apps.openshift.io]: broken
  • [sig-cli] oc probe can ensure the probe command is functioning as expected on deploymentconfigs [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain spec+status for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • oc explain should contain proper fields description for apps.openshift.io [apigroup:apps.openshift.io]: testing DCs
  • [sig-cli] oc basics can create deploymentconfig and clusterquota [apigroup:apps.openshift.io]: testing DCs
  • [sig-scalability][Feature:Performance] Load cluster should populate the cluster [Slow][Serial]: broken by https://github.com/openshift/origin/pull/26072 as the e2e is expected to be run separately: The following error is produced:
 [sig-scalability][Feature:Performance] Load cluster [It] should populate the cluster [Slow][Serial][apigroup:template.openshift.io][apigroup:build.openshift.io]
github.com/openshift/origin/test/extended/cluster/cl.go:63

  [FAILED] Unable to process template file. Error: Error running /usr/bin/oc process -f /home/jchaloup/Projects/src/github.com/openshift/origin/test/extended/testdata/cluster/quickstarts/cakephp-mysql.json -p IDENTIFIER=0:
  StdOut>

  StdErr>
  error: unknown parameter name "IDENTIFIER"
  exit status 1
  In [It] at: github.com/openshift/origin/test/extended/cluster/utils.go:529 @ 07/30/24 13:07:16.067
------------------------------

IDENTIFIER was removed by https://github.com/openshift/origin/pull/26072.

  • [sig-scalability]: can't find any run in https://search.dptools.openshift.org/?search=%5C%5Bsig-scalability%5C%5D&maxAge=48h&context=1&type=junit&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 30 '24 11:07 openshift-ci-robot

Job Failure Risk Analysis for sha: 481a9d35ff1ef13aa6579044c097f6823a7e11ba

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade High
[sig-apps] job-upgrade
This test has passed 100.00% of 506 runs on jobs ['periodic-ci-openshift-release-master-ci-4.17-e2e-aws-ovn-upgrade'] in the last 14 days.

openshift-trt-bot avatar Jul 30 '24 14:07 openshift-trt-bot

Job Failure Risk Analysis for sha: 59ecd441eedd9d54aa126ce117623cd9ccca5511

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Medium
[sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace
This test has passed 95.95% of 148 runs on release 4.17 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.

openshift-trt-bot avatar Jul 30 '24 18:07 openshift-trt-bot

/retest-required

ingvagabund avatar Jul 31 '24 08:07 ingvagabund

ci/prow/e2e-gcp-ovn-builds

[sig-builds][Feature:Builds][Slow] can use private repositories as build input build using an HTTP token should be able to clone source code via an HTTP token [apigroup:build.openshift.io]

Based on https://prow.ci.openshift.org/job-history/gs/test-platform-results/pr-logs/directory/pull-ci-openshift-origin-master-e2e-gcp-ovn-builds the job has been failing for other PRs as well.

ci/prow/e2e-aws-ovn-ipsec-serial

Often failing with failed installation

ingvagabund avatar Jul 31 '24 15:07 ingvagabund

/retest-required

ingvagabund avatar Jul 31 '24 15:07 ingvagabund

Job Failure Risk Analysis for sha: 409d1d8918f4a9f6dcb167d2a17a805f0bf70186

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-ipsec-serial IncompleteTests
Tests for this run (27) are below the historical average (495): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Jul 31 '24 18:07 openshift-trt-bot

/retest-required

ingvagabund avatar Aug 01 '24 06:08 ingvagabund

/test e2e-aws-ovn-upgrade

ingvagabund avatar Aug 01 '24 06:08 ingvagabund

/retest-required

ingvagabund avatar Aug 01 '24 06:08 ingvagabund

If we are no longer testing DCs, how do we ensure that the customers who are relying on DCs do not get broken as we move towards future releases?

JoelSpeed avatar Aug 01 '24 12:08 JoelSpeed

There's a periodic job that tests the case where no additional capabilities are enabled. I wonder whether we have a similar job where all the known capabilities are enabled. Checking o/release repo for any suspicious job.

DCs have their own set of DC specific tests. E.g. [sig-apps][Feature:DeploymentConfig]. Plus, there are still other tests that rely on apps.openshift.io API to be installed. Some of them were duplicated and rewritten to Deployments instead of removed.

ingvagabund avatar Aug 01 '24 12:08 ingvagabund

For the tests renamed to remove the apps.openshift.io apigroup, these need rename records in the mapping repo so that component readiness can continue to compare their results with past releases. https://github.com/openshift-eng/ci-test-mapping should have instructions.

We do need to understand where and how DCs continue to be tested per Joel's comment. You mention there are tests that require apps.openshift.io installed, what test(s) is that and how would they NOT fail on default install? TRT couldn't quite piece together how this will continue testing.

Also would recommend you run the 4.17 nightly blocking with /payload command on the other PR for this to actually disable, once this merges.

dgoodwin avatar Aug 01 '24 13:08 dgoodwin

Lemme get back to you both once I have an answer for how DCs will continue to be tested

ingvagabund avatar Aug 01 '24 15:08 ingvagabund

Job Failure Risk Analysis for sha: dfb99cf1ca96f3c2531604afe27d38eecf79bce9

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade High
[sig-apps] job-upgrade
This test has passed 100.00% of 504 runs on jobs ['periodic-ci-openshift-release-master-ci-4.17-e2e-aws-ovn-upgrade'] in the last 14 days.

openshift-trt-bot avatar Aug 01 '24 16:08 openshift-trt-bot

https://github.com/openshift/origin/tree/master/test/extended/controller_manager is a home for [sig-apps][Feature:DeploymentConfig]. Also, https://github.com/openshift/origin/blob/master/test/extended/testdata/cmd/test/cmd/deployments.sh is going through various cases for deployments as well. The DC coverage is still present.

ingvagabund avatar Aug 01 '24 16:08 ingvagabund

@dgoodwin @JoelSpeed one way is to introduce a new periodic job that will run all e2es with all caps enabled. There's no point of running a new e2e with just DeploymentConfig capability enabled in addition. Also probably unlikely to run a new e2e with all caps enabled for every PR across all repositories given how many variants we have. Nevertheless, given the "no capabilities" periodic job is going red I wonder if the new periodic job will end up the same?

ingvagabund avatar Aug 01 '24 16:08 ingvagabund

@JoelSpeed's response from https://github.com/openshift/api/pull/1954:

Having an all capabilities test makes sense to me, but we need to make sure that something in origin is still exercising the DCs, else that will be pointless. Not sure how to make those tests only run on those particular clusters but I'm sure there's probably precedent for that.

ingvagabund avatar Aug 01 '24 16:08 ingvagabund

/retest-required

ingvagabund avatar Aug 01 '24 16:08 ingvagabund

/retest-required

ingvagabund avatar Aug 02 '24 06:08 ingvagabund

/retest

ingvagabund avatar Aug 02 '24 08:08 ingvagabund