volcano icon indicating copy to clipboard operation
volcano copied to clipboard

pod-update-performance

Open molei20021 opened this issue 11 months ago • 5 comments

If there are thousands of pending pods in cluster, pod status update may become performance bottleneck of the whole system. I add PodStatusRateLimit config including minIntervalSec, minPodNum, enable. When the pod num of cluster is greater than minPodNum(default 10000), the times of pod status update will be limited by minIntervalSec(default 60s). If the pod unscheduleable status is updated minIntervalSec ago, we will ignore status update this time until after minIntervalSec.

molei20021 avatar Dec 20 '24 09:12 molei20021

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: To complete the pull request process, please assign k82cn You can assign the PR to them by writing /assign @k82cn in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

volcano-sh-bot avatar Dec 20 '24 09:12 volcano-sh-bot

Is there a backgroup for this PR? Actually, pod will not be updated if there are no changes.

lowang-bh avatar Dec 21 '24 01:12 lowang-bh

Is there a backgroup for this PR? Actually, pod will not be updated if there are no changes.

Our

minIntervalSec

For example, one of the pod unscheduable reason is like "Pod %s/%s can possibly be assigned to %s" this may often change.

molei20021 avatar Dec 24 '24 08:12 molei20021

@molei20021: PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

volcano-sh-bot avatar Jan 20 '25 01:01 volcano-sh-bot

Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

stale[bot] avatar May 08 '25 01:05 stale[bot]