origin icon indicating copy to clipboard operation
origin copied to clipboard

External binary registry

Open jupierce opened this issue 1 year ago • 5 comments

Allows other components beyond hyperkube to register the fact that they carry an external test binary. All binaries can now contribute to the available external tests.

jupierce avatar Aug 20 '24 21:08 jupierce

A couple drive bys. Looks like @stbenjam has the review.

deads2k avatar Aug 22 '24 19:08 deads2k

Job Failure Risk Analysis for sha: 3d86e14c845d40f4f4d6ac81379e52f426072bcd

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-ipsec-serial High
[sig-arch] events should not repeat pathologically for ns/openshift-authentication-operator
This test has passed 100.00% of 41 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (23) are below the historical average (1965): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones IncompleteTests
Tests for this run (100) are below the historical average (1922): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Low
[sig-cluster-lifecycle] pathological event should not see excessive Back-off restarting failed containers for ns/openshift-marketplace
This test has passed 77.36% of 159 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.

openshift-trt-bot avatar Aug 22 '24 22:08 openshift-trt-bot

Job Failure Risk Analysis for sha: 6c407e6a58a19fc625bba641fadd62c3ae844108

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout High
operator conditions kube-apiserver
This test has passed 100.00% of 14 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-kube-apiserver-rollout'] in the last 14 days.

openshift-trt-bot avatar Oct 02 '24 00:10 openshift-trt-bot

Job Failure Risk Analysis for sha: e7993418043e4b3897ee21d7a417234cd27d3835

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout Low
[Conformance][Suite:openshift/kube-apiserver/rollout][Jira:"kube-apiserver"][sig-kube-apiserver] kube-apiserver should roll out new revisions without disruption [apigroup:config.openshift.io][apigroup:operator.openshift.io]
This test has passed 64.29% of 14 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-kube-apiserver-rollout'] in the last 14 days.

openshift-trt-bot avatar Oct 02 '24 23:10 openshift-trt-bot

Job Failure Risk Analysis for sha: 32be64249092cdd8f9eb6d18321b4babc2feb153

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (23) are below the historical average (617): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (23) are below the historical average (1464): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Oct 03 '24 06:10 openshift-trt-bot

metal IPv6 pulled external images 🎉

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/29025/pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6/1841655639193948160/artifacts/e2e-metal-ipi-ovn-ipv6/baremetalds-e2e-test/build-log.txt

stbenjam avatar Oct 03 '24 10:10 stbenjam

Job Failure Risk Analysis for sha: 9f6c07082682705cc41cfed79ae775e5fbe587fe

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (23) are below the historical average (634): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (23) are below the historical average (1514): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Medium
[sig-architecture] platform pods in ns/openshift-e2e-loki should not exit an excessive amount of times
This test has passed 93.98% of 249 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.
---
[sig-network-edge] Verify DNS availability during and after upgrade success
This test has passed 93.17% of 249 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.

Open Bugs
SNO Regression for [sig-network-edge] Verify DNS availability during and after upgrade success

openshift-trt-bot avatar Oct 04 '24 19:10 openshift-trt-bot

@jupierce: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gcp-ovn-builds 6c407e6a58a19fc625bba641fadd62c3ae844108 link true /test e2e-gcp-ovn-builds
ci/prow/e2e-aws-ovn-single-node-upgrade 3d0ed9dd4ce8fdb6bb78c93e22e1646514e35294 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-ipsec-serial 3d0ed9dd4ce8fdb6bb78c93e22e1646514e35294 link false /test e2e-aws-ovn-ipsec-serial
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout 3d0ed9dd4ce8fdb6bb78c93e22e1646514e35294 link false /test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-aws-ovn-kube-apiserver-rollout 3d0ed9dd4ce8fdb6bb78c93e22e1646514e35294 link false /test e2e-aws-ovn-kube-apiserver-rollout

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Oct 05 '24 00:10 openshift-ci[bot]

Job Failure Risk Analysis for sha: 3d0ed9dd4ce8fdb6bb78c93e22e1646514e35294

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (23) are below the historical average (635): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (23) are below the historical average (1498): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Oct 05 '24 00:10 openshift-trt-bot

/payload 4.18 nightly blocking

jupierce avatar Oct 07 '24 13:10 jupierce

@jupierce: trigger 11 job(s) of type blocking for the nightly release of OCP 4.18

  • periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-upgrade
  • periodic-ci-openshift-release-master-ci-4.18-e2e-azure-ovn-upgrade
  • periodic-ci-openshift-release-master-ci-4.18-upgrade-from-stable-4.17-e2e-gcp-ovn-rt-upgrade
  • periodic-ci-openshift-hypershift-release-4.18-periodics-e2e-aws-ovn-conformance
  • periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial
  • periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-upgrade
  • periodic-ci-openshift-release-master-nightly-4.18-fips-payload-scan
  • periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-bm
  • periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-ipv6
  • periodic-ci-openshift-microshift-release-4.18-periodics-e2e-aws-ovn-ocp-conformance
  • periodic-ci-openshift-microshift-release-4.18-periodics-e2e-aws-ovn-ocp-conformance-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/32184070-84b2-11ef-8404-8341974d9d6f-0

openshift-ci[bot] avatar Oct 07 '24 13:10 openshift-ci[bot]

Job Failure Risk Analysis for sha: 5af36926048fd37d4c4283b884826b9594a9c0ca

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-ipsec-serial High
[sig-architecture] platform pods in ns/openshift-image-registry should not exit an excessive amount of times
This test has passed 100.00% of 42 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.
---
[sig-architecture] platform pods in ns/openshift-monitoring should not exit an excessive amount of times
This test has passed 100.00% of 42 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.
---
[sig-architecture] platform pods in ns/openshift-machine-config-operator should not exit an excessive amount of times
This test has passed 100.00% of 42 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.
---
[bz-Management Console] clusteroperator/console should not change condition/Available
This test has passed 100.00% of 54 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.

Open Bugs
clusteroperator/console: unexpected state transitions during e2e test run
---
Showing 4 of 13 test results

openshift-trt-bot avatar Oct 07 '24 18:10 openshift-trt-bot

/lgtm

stbenjam avatar Oct 07 '24 18:10 stbenjam

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jupierce, stbenjam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Oct 07 '24 18:10 openshift-ci[bot]

/retitle NO-JIRA: external binary registry

stbenjam avatar Oct 08 '24 11:10 stbenjam

/skip

stbenjam avatar Oct 08 '24 11:10 stbenjam

@jupierce: This pull request explicitly references no jira issue.

In response to this:

Allows other components beyond hyperkube to register the fact that they carry an external test binary. All binaries can now contribute to the available external tests.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Oct 08 '24 11:10 openshift-ci-robot

/retest-required

Remaining retests: 0 against base HEAD 87600e2ed5bfd6a8f5de18198c8db04d7d152c28 and 2 for PR HEAD 5af36926048fd37d4c4283b884826b9594a9c0ca in total

openshift-ci-robot avatar Oct 08 '24 12:10 openshift-ci-robot

/override ci/prow/e2e-aws-ovn-fips /override ci/prow/e2e-aws-ovn-serial

These two failures are unrelated (tests ran)

stbenjam avatar Oct 08 '24 12:10 stbenjam

@stbenjam: Overrode contexts on behalf of stbenjam: ci/prow/e2e-aws-ovn-fips, ci/prow/e2e-aws-ovn-serial

In response to this:

/override ci/prow/e2e-aws-ovn-fips /override ci/prow/e2e-aws-ovn-serial

These two failures are unrelated (tests raun)

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar Oct 08 '24 12:10 openshift-ci[bot]

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.18.0-202410081810.p0.gd068b84.assembly.stream.el9. All builds following this will include this PR.

openshift-bot avatar Oct 08 '24 19:10 openshift-bot