origin icon indicating copy to clipboard operation
origin copied to clipboard

TRT-1575: Add more exceptions for operator degraded cases

Open xueqzhan opened this issue 1 year ago • 22 comments
trafficstars

xueqzhan avatar Oct 09 '24 20:10 xueqzhan

/lgtm

dgoodwin avatar Oct 16 '24 12:10 dgoodwin

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, xueqzhan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • ~~OWNERS~~ [dgoodwin,xueqzhan]

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Oct 16 '24 12:10 openshift-ci[bot]

@xueqzhan: This pull request references TRT-1575 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.18.0" version, but no target version was set.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Oct 16 '24 13:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 9303d0ee0a1543c088f5a9285a5405b5d10a3ad7 and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 16 '24 13:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 14517117d77358883caa228edd8e70d7e4c0212c and 1 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 16 '24 16:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 3a394a9df776b44f4fd6ba59dd6fc4dac13b4bed and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 00:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 3a394a9df776b44f4fd6ba59dd6fc4dac13b4bed and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 02:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 63e67bd3670b3873ff0eef086f08ac61a1bd1cb5 and 1 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 04:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 63e67bd3670b3873ff0eef086f08ac61a1bd1cb5 and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 07:10 openshift-ci-robot

/retest ci/prow/e2e-aws-ovn-microshift-serial

xueqzhan avatar Oct 17 '24 11:10 xueqzhan

@xueqzhan: The /retest command does not accept any targets. The following commands are available to trigger required jobs:

  • /test e2e-aws-jenkins
  • /test e2e-aws-ovn-edge-zones
  • /test e2e-aws-ovn-fips
  • /test e2e-aws-ovn-image-registry
  • /test e2e-aws-ovn-microshift
  • /test e2e-aws-ovn-microshift-serial
  • /test e2e-aws-ovn-serial
  • /test e2e-gcp-ovn
  • /test e2e-gcp-ovn-builds
  • /test e2e-gcp-ovn-image-ecosystem
  • /test e2e-gcp-ovn-upgrade
  • /test e2e-metal-ipi-ovn-ipv6
  • /test images
  • /test lint
  • /test unit
  • /test verify
  • /test verify-deps

The following commands are available to trigger optional jobs:

  • /test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
  • /test e2e-agnostic-ovn-cmd
  • /test e2e-aws
  • /test e2e-aws-csi
  • /test e2e-aws-disruptive
  • /test e2e-aws-etcd-certrotation
  • /test e2e-aws-etcd-recovery
  • /test e2e-aws-ovn
  • /test e2e-aws-ovn-cgroupsv2
  • /test e2e-aws-ovn-etcd-scaling
  • /test e2e-aws-ovn-kube-apiserver-rollout
  • /test e2e-aws-ovn-kubevirt
  • /test e2e-aws-ovn-single-node
  • /test e2e-aws-ovn-single-node-serial
  • /test e2e-aws-ovn-single-node-techpreview
  • /test e2e-aws-ovn-single-node-techpreview-serial
  • /test e2e-aws-ovn-single-node-upgrade
  • /test e2e-aws-ovn-upgrade
  • /test e2e-aws-ovn-upgrade-rollback
  • /test e2e-aws-ovn-upi
  • /test e2e-aws-proxy
  • /test e2e-azure
  • /test e2e-azure-ovn-etcd-scaling
  • /test e2e-azure-ovn-upgrade
  • /test e2e-baremetalds-kubevirt
  • /test e2e-external-aws
  • /test e2e-external-aws-ccm
  • /test e2e-external-vsphere-ccm
  • /test e2e-gcp-csi
  • /test e2e-gcp-disruptive
  • /test e2e-gcp-fips-serial
  • /test e2e-gcp-ovn-etcd-scaling
  • /test e2e-gcp-ovn-rt-upgrade
  • /test e2e-gcp-ovn-techpreview
  • /test e2e-gcp-ovn-techpreview-serial
  • /test e2e-metal-ipi-ovn
  • /test e2e-metal-ipi-ovn-dualstack
  • /test e2e-metal-ipi-ovn-dualstack-local-gateway
  • /test e2e-metal-ipi-ovn-kube-apiserver-rollout
  • /test e2e-metal-ipi-serial
  • /test e2e-metal-ipi-serial-ovn-ipv6
  • /test e2e-metal-ipi-virtualmedia
  • /test e2e-openstack-ovn
  • /test e2e-openstack-serial
  • /test e2e-vsphere
  • /test e2e-vsphere-ovn-dualstack-primaryv6
  • /test e2e-vsphere-ovn-etcd-scaling
  • /test okd-e2e-gcp
  • /test okd-scos-images

Use /test all to run the following jobs that were automatically triggered:

  • pull-ci-openshift-origin-master-e2e-agnostic-ovn-cmd
  • pull-ci-openshift-origin-master-e2e-aws-csi
  • pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2
  • pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones
  • pull-ci-openshift-origin-master-e2e-aws-ovn-fips
  • pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout
  • pull-ci-openshift-origin-master-e2e-aws-ovn-microshift
  • pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade
  • pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade
  • pull-ci-openshift-origin-master-e2e-gcp-csi
  • pull-ci-openshift-origin-master-e2e-gcp-ovn
  • pull-ci-openshift-origin-master-e2e-gcp-ovn-rt-upgrade
  • pull-ci-openshift-origin-master-e2e-gcp-ovn-upgrade
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout
  • pull-ci-openshift-origin-master-e2e-openstack-ovn
  • pull-ci-openshift-origin-master-images
  • pull-ci-openshift-origin-master-lint
  • pull-ci-openshift-origin-master-unit
  • pull-ci-openshift-origin-master-verify
  • pull-ci-openshift-origin-master-verify-deps

In response to this:

/retest ci/prow/e2e-aws-ovn-microshift-serial

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar Oct 17 '24 11:10 openshift-ci[bot]

/test e2e-aws-ovn-microshift-serial

xueqzhan avatar Oct 17 '24 11:10 xueqzhan

/retest-required

Remaining retests: 0 against base HEAD 63e67bd3670b3873ff0eef086f08ac61a1bd1cb5 and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 15:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD a2d592a52648a981e857e5b85cce7983fe8abffc and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 18:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 8895303805184c730043c50f3beaf9aa163dbd62 and 1 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 17 '24 22:10 openshift-ci-robot

/test e2e-aws-ovn-microshift-serial

pacevedom avatar Oct 18 '24 08:10 pacevedom

/test e2e-aws-ovn-microshift-serial

pacevedom avatar Oct 18 '24 10:10 pacevedom

/retest-required

Remaining retests: 0 against base HEAD 9c2f988b5e64eb62152a9dc3c7e99d4ebeb3a8cb and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 18 '24 17:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 9c2f988b5e64eb62152a9dc3c7e99d4ebeb3a8cb and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 18 '24 19:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 9c2f988b5e64eb62152a9dc3c7e99d4ebeb3a8cb and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 18 '24 21:10 openshift-ci-robot

e2e-aws-ovn-microshift-serial are failing with this error, which is not present in the parallel version?

Suite run returned error: unable to extract image references from release payload: failed extracting image-references from "registry.build10.ci.openshift.org/ci-op-g7h5sfp1/release@sha256:70eed17e6f93934c7729614aabe61c0e9691326a2877975709793b21c8f7f564": error during image extract: exit status 1 (error: unable to read image registry.build10.ci.openshift.org/ci-op-g7h5sfp1/release@sha256:70eed17e6f93934c7729614aabe61c0e9691326a2877975709793b21c8f7f564: unauthorized: authentication required

How is this happening here, if the origin image is built from the PR itself?

pacevedom avatar Oct 21 '24 07:10 pacevedom

/retest-required

Remaining retests: 0 against base HEAD 9c2f988b5e64eb62152a9dc3c7e99d4ebeb3a8cb and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 21 '24 11:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 9c2f988b5e64eb62152a9dc3c7e99d4ebeb3a8cb and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 21 '24 16:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 83d6c4c3b255ce43dbea5364ca17f4a9aacecebe and 1 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 21 '24 18:10 openshift-ci-robot

Job Failure Risk Analysis for sha: 40a921f45025575f611c02cc64f0fc12f895a4f3

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (12) are below the historical average (540): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Oct 21 '24 19:10 openshift-trt-bot

/retest-required

Remaining retests: 0 against base HEAD 83d6c4c3b255ce43dbea5364ca17f4a9aacecebe and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 21 '24 22:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 83d6c4c3b255ce43dbea5364ca17f4a9aacecebe and 2 for PR HEAD 40a921f45025575f611c02cc64f0fc12f895a4f3 in total

openshift-ci-robot avatar Oct 22 '24 13:10 openshift-ci-robot

@xueqzhan: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-ipsec-serial 40a921f45025575f611c02cc64f0fc12f895a4f3 link false /test e2e-aws-ovn-ipsec-serial
ci/prow/e2e-aws-ovn-single-node 40a921f45025575f611c02cc64f0fc12f895a4f3 link false /test e2e-aws-ovn-single-node

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Oct 22 '24 16:10 openshift-ci[bot]

/override e2e-metal-ipi-ovn-ipv6

xueqzhan avatar Oct 22 '24 16:10 xueqzhan

@xueqzhan: /override requires failed status contexts, check run or a prowjob name to operate on. The following unknown contexts/checkruns were given:

  • e2e-metal-ipi-ovn-ipv6

Only the following failed contexts/checkruns were expected:

  • ci/prow/e2e-agnostic-ovn-cmd
  • ci/prow/e2e-aws-csi
  • ci/prow/e2e-aws-ovn-cgroupsv2
  • ci/prow/e2e-aws-ovn-edge-zones
  • ci/prow/e2e-aws-ovn-fips
  • ci/prow/e2e-aws-ovn-ipsec-serial
  • ci/prow/e2e-aws-ovn-kube-apiserver-rollout
  • ci/prow/e2e-aws-ovn-microshift
  • ci/prow/e2e-aws-ovn-microshift-serial
  • ci/prow/e2e-aws-ovn-serial
  • ci/prow/e2e-aws-ovn-single-node
  • ci/prow/e2e-aws-ovn-single-node-serial
  • ci/prow/e2e-aws-ovn-single-node-upgrade
  • ci/prow/e2e-aws-ovn-upgrade
  • ci/prow/e2e-gcp-csi
  • ci/prow/e2e-gcp-ovn
  • ci/prow/e2e-gcp-ovn-rt-upgrade
  • ci/prow/e2e-gcp-ovn-upgrade
  • ci/prow/e2e-metal-ipi-ovn
  • ci/prow/e2e-metal-ipi-ovn-ipv6
  • ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout
  • ci/prow/e2e-openstack-ovn
  • ci/prow/images
  • ci/prow/lint
  • ci/prow/unit
  • ci/prow/verify
  • ci/prow/verify-deps
  • pull-ci-openshift-origin-master-e2e-agnostic-ovn-cmd
  • pull-ci-openshift-origin-master-e2e-aws-csi
  • pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2
  • pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones
  • pull-ci-openshift-origin-master-e2e-aws-ovn-fips
  • pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout
  • pull-ci-openshift-origin-master-e2e-aws-ovn-microshift
  • pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial
  • pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade
  • pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade
  • pull-ci-openshift-origin-master-e2e-gcp-csi
  • pull-ci-openshift-origin-master-e2e-gcp-ovn
  • pull-ci-openshift-origin-master-e2e-gcp-ovn-rt-upgrade
  • pull-ci-openshift-origin-master-e2e-gcp-ovn-upgrade
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6
  • pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout
  • pull-ci-openshift-origin-master-e2e-openstack-ovn
  • pull-ci-openshift-origin-master-images
  • pull-ci-openshift-origin-master-lint
  • pull-ci-openshift-origin-master-unit
  • pull-ci-openshift-origin-master-verify
  • pull-ci-openshift-origin-master-verify-deps
  • tide

If you are trying to override a checkrun that has a space in it, you must put a double quote on the context.

In response to this:

/override e2e-metal-ipi-ovn-ipv6

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar Oct 22 '24 16:10 openshift-ci[bot]