argo-rollouts icon indicating copy to clipboard operation
argo-rollouts copied to clipboard

kubectl argo rollouts dashboard OOM kill

Open kzcPo opened this issue 2 years ago • 18 comments

Summary

What happened/what you expected to happen? kubectl argo rollouts dashboard high memory usage. image

before long time, this pod OOM kill!!

Diagnostics

kubectl-argo-rollouts: v1.2.1+51c874c
  BuildDate: 2022-05-13T20:40:45Z
  GitCommit: 51c874cb18e6adccf677766ac561c3dbf69a8ec1
  GitTreeState: clean
  GoVersion: go1.17.6
  Compiler: gc
  Platform: linux/amd64

Message from the maintainers:

Impacted by this bug? Give it a 👍. We prioritize the issues with the most 👍.

kzcPo avatar Jun 14 '22 01:06 kzcPo

@kzcPo Could you provide steps to reproduce? How many rollouts Manifest for rollout

perenesenko avatar Jun 14 '22 17:06 perenesenko

@kzcPo Could you provide steps to reproduce? How many rollouts Manifest for rollout

  1. I run a command kubectl argo rollouts dashboard.

  2. My program calls API every 10s. /api/v1/rollouts/online/info

  3. Through dashboash, you can see that the response time of this interface is 3S. image

  4. At this time, the pod CPU continues to grow until the OOM kill.

It also takes 3S to execute by command.

[root@argo-rollouts-dashboard-5cf947cdc9-ltkmn /]# time kubectl argo rollouts get rollout eff-noahbe -n online
Name:            eff-noahbe
Namespace:       online
Status:          ✔ Healthy
Strategy:        BlueGreen
Images:          xxxx.com/taqu/eff-noahbe:online_202206141748_release_v2 (stable, active)
Replicas:
  Desired:       1
  Current:       1
  Updated:       1
  Ready:         1
  Available:     1

NAME                                    KIND        STATUS        AGE    INFO
⟳ eff-noahbe                            Rollout     ✔ Healthy     14d    
├──# revision:7                                                          
│  └──⧉ eff-noahbe-79dc855c76           ReplicaSet  ✔ Healthy     15h    stable,active
│     └──□ eff-noahbe-79dc855c76-rbqs5  Pod         ✔ Running     15h    ready:1/1
├──# revision:6                                                          
│  └──⧉ eff-noahbe-7b7fbc6cf6           ReplicaSet  • ScaledDown  4d18h  
├──# revision:5                                                          
│  └──⧉ eff-noahbe-74675b9cff           ReplicaSet  • ScaledDown  4d22h  
├──# revision:4                                                          
│  └──⧉ eff-noahbe-5ccfdd6d88           ReplicaSet  • ScaledDown  5d18h  
├──# revision:3                                                          
│  └──⧉ eff-noahbe-7fb8d7ffbd           ReplicaSet  • ScaledDown  7d22h  
├──# revision:2                                                          
│  └──⧉ eff-noahbe-bbdd56bf             ReplicaSet  • ScaledDown  12d    
└──# revision:1                                                          
   └──⧉ eff-noahbe-59b98696c7           ReplicaSet  • ScaledDown  14d    

real    0m2.956s
user    0m3.185s
sys     0m0.743s

Is there an API server that can be provided for my program calls? Can this query be optimized for time consumption?

kzcPo avatar Jun 15 '22 01:06 kzcPo

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Oct 18 '22 04:10 github-actions[bot]

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Jan 31 '23 02:01 github-actions[bot]

你好,我已经收到邮件!

kzcPo avatar Jan 31 '23 02:01 kzcPo

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Apr 03 '23 02:04 github-actions[bot]

你好,我已经收到邮件!

kzcPo avatar Apr 03 '23 02:04 kzcPo

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Jun 03 '23 02:06 github-actions[bot]

你好,我已经收到邮件!

kzcPo avatar Jun 03 '23 02:06 kzcPo

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Aug 04 '23 02:08 github-actions[bot]

你好,我已经收到邮件!

kzcPo avatar Aug 04 '23 02:08 kzcPo

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] avatar Oct 05 '23 02:10 github-actions[bot]

你好,我已经收到邮件!

kzcPo avatar Oct 05 '23 02:10 kzcPo

Hello, guys! Are there any updates?

m-shalenko avatar Dec 11 '23 14:12 m-shalenko

你好,我已经收到邮件!

kzcPo avatar Dec 11 '23 14:12 kzcPo

Hello! Are there any updates. I have also observed a similar behavior with Argo Rollouts Dashboard being OOM killed due to rising memory. We expect that there is a memory leak.

michellebeard avatar Mar 08 '24 18:03 michellebeard