origin icon indicating copy to clipboard operation
origin copied to clipboard

NO-JIRA: add api error rate observed by kubelet, kcm, and scheduler

Open tkashem opened this issue 1 year ago • 9 comments
trafficstars

tkashem avatar Sep 05 '24 20:09 tkashem

/reest

tkashem avatar Sep 05 '24 23:09 tkashem

/retest

tkashem avatar Sep 05 '24 23:09 tkashem

/retest

tkashem avatar Sep 06 '24 11:09 tkashem

Job Failure Risk Analysis for sha: 619af214695af5a91691cada359ef6008575e7e3

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-serial IncompleteTests
Tests for this run (102) are below the historical average (703): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Sep 06 '24 16:09 openshift-trt-bot

Job Failure Risk Analysis for sha: 01d961fc995c65011ff632c6993a723fdb57604f

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (18) are below the historical average (463): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

openshift-trt-bot avatar Sep 10 '24 23:09 openshift-trt-bot

@tkashem: This pull request explicitly references no jira issue.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Sep 11 '24 17:09 openshift-ci-robot

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close. Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

openshift-bot avatar Dec 31 '24 09:12 openshift-bot

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity. Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten /remove-lifecycle stale

openshift-bot avatar Jan 31 '25 00:01 openshift-bot

Job Failure Risk Analysis for sha: 3412964fc373e0bef819b5ae62869b51fd6e5c88

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade High
[sig-api-machinery] disruption/cache-kube-api connection/new should be available throughout the test
This test has passed 99.90% of 5825 runs on release 4.18 [Overall] in the last week.
---
[sig-api-machinery] disruption/kube-api connection/reused should be available throughout the test
This test has passed 99.74% of 5825 runs on release 4.18 [Overall] in the last week.
---
[sig-api-machinery] disruption/kube-api connection/new should be available throughout the test
This test has passed 99.88% of 5825 runs on release 4.18 [Overall] in the last week.
---
[sig-api-machinery] disruption/cache-kube-api connection/reused should be available throughout the test
This test has passed 99.95% of 5825 runs on release 4.18 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial High
[sig-scheduling] SchedulerPredicates [Serial] validates resource limits of pods that are allowed to run [Conformance] [Suite:openshift/conformance/serial/minimal] [Suite:k8s]
This test has passed 100.00% of 54 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-single-node-serial'] in the last 14 days.
---
[sig-auth][Feature:LDAP][Serial] ldap group sync can sync groups from ldap [apigroup:user.openshift.io][apigroup:authorization.openshift.io][apigroup:security.openshift.io] [Suite:openshift/conformance/serial]
This test has passed 100.00% of 54 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-single-node-serial'] in the last 14 days.
---
[sig-node] static pods should start after being created
This test has passed 98.15% of 54 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-single-node-serial'] in the last 14 days.

Open Bugs
Static pod controller pods sometimes fail to start
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout Low
[Conformance][Suite:openshift/kube-apiserver/rollout][Jira:"kube-apiserver"][sig-kube-apiserver] kube-apiserver should roll out new revisions without disruption [apigroup:config.openshift.io][apigroup:operator.openshift.io]
This test has passed 78.57% of 14 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-kube-apiserver-rollout'] in the last 14 days.

openshift-trt[bot] avatar Feb 12 '25 21:02 openshift-trt[bot]

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen. Mark the issue as fresh by commenting /remove-lifecycle rotten. Exclude this issue from closing again by commenting /lifecycle frozen.

/close

openshift-bot avatar Mar 29 '25 00:03 openshift-bot

@openshift-bot: Closed this PR.

In response to this:

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen. Mark the issue as fresh by commenting /remove-lifecycle rotten. Exclude this issue from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar Mar 29 '25 00:03 openshift-ci[bot]

/reopen

tkashem avatar Apr 08 '25 12:04 tkashem

@tkashem: Reopened this PR.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci[bot] avatar Apr 08 '25 12:04 openshift-ci[bot]

/cc @dgoodwin @kannon92

tkashem avatar Apr 08 '25 17:04 tkashem

/lgtm /approve

dgoodwin avatar Apr 08 '25 17:04 dgoodwin

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, tkashem

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Apr 08 '25 17:04 openshift-ci[bot]

/retest-required

Remaining retests: 0 against base HEAD 67ee73e00ecf27baa265014430e0539bd41aeca0 and 2 for PR HEAD 7739612e7927719c61381a64382b337da56a1078 in total

openshift-ci-robot avatar Apr 08 '25 18:04 openshift-ci-robot

@tkashem: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-ipsec-serial 3412964fc373e0bef819b5ae62869b51fd6e5c88 link false /test e2e-aws-ovn-ipsec-serial
ci/prow/e2e-gcp-ovn-builds 3412964fc373e0bef819b5ae62869b51fd6e5c88 link true /test e2e-gcp-ovn-builds
ci/prow/e2e-metal-ipi-ovn-dualstack-bgp-techpreview 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-metal-ipi-ovn-dualstack-bgp-techpreview
ci/prow/okd-e2e-gcp 7739612e7927719c61381a64382b337da56a1078 link false /test okd-e2e-gcp
ci/prow/e2e-metal-ipi-ovn 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-metal-ipi-ovn
ci/prow/e2e-openstack-serial 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-openstack-serial
ci/prow/e2e-aws-ovn-etcd-scaling 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-single-node 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-aws-ovn-single-node-serial 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-azure-ovn-upgrade 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-azure-ovn-upgrade
ci/prow/e2e-metal-ipi-serial 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-metal-ipi-serial
ci/prow/e2e-aws 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws
ci/prow/e2e-vsphere-ovn-etcd-scaling 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-vsphere-ovn-etcd-scaling
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/e2e-aws-ovn-kube-apiserver-rollout 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-azure-ovn-etcd-scaling 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-azure-ovn-etcd-scaling
ci/prow/e2e-gcp-fips-serial 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-gcp-fips-serial
ci/prow/e2e-aws-disruptive 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-aws-disruptive
ci/prow/e2e-gcp-disruptive 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-gcp-disruptive
ci/prow/e2e-agnostic-ovn-cmd 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-agnostic-ovn-cmd
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-gcp-ovn-etcd-scaling 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-gcp-ovn-etcd-scaling
ci/prow/e2e-hypershift-conformance 7739612e7927719c61381a64382b337da56a1078 link false /test e2e-hypershift-conformance

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Apr 08 '25 22:04 openshift-ci[bot]

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.19.0-202504090015.p0.gd2eafcc.assembly.stream.el9. All builds following this will include this PR.

openshift-bot avatar Apr 09 '25 01:04 openshift-bot