kube-ops-view icon indicating copy to clipboard operation
kube-ops-view copied to clipboard

backoff does not appear to work

Open zerkms opened this issue 6 years ago • 5 comments

I installed kube-ops-view with wrong permissions initially, and after fixing them here is what I still see in the events response:

{"cluster_id":"10-52-0-1:443","status":{"backoff":{"tries":4,"next_try":1565748624.5507348}}}

At the moment it's 1565749605, so the retry should have happened 15 minutes ago, why it had not.

If I grep logs I see

ERROR:kube_ops_view.update:Failed to query cluster 10-52-0-1:443 (https://10.52.0.1:443): 403 Forbidden (try 1, wait 6 seconds)
ERROR:kube_ops_view.update:Failed to query cluster 10-52-0-1:443 (https://10.52.0.1:443): 403 Forbidden (try 2, wait 9 seconds)
ERROR:kube_ops_view.update:Failed to query cluster 10-52-0-1:443 (https://10.52.0.1:443): 403 Forbidden (try 3, wait 18 seconds)
ERROR:kube_ops_view.update:Failed to query cluster 10-52-0-1:443 (https://10.52.0.1:443): 403 Forbidden (try 4, wait 35 seconds)

the last line also happened slightly earlier than 15 minutes ago.

zerkms avatar Aug 14 '19 02:08 zerkms

UPD: dropping a redis pod helped, so at this point I'm unable to investigate at what state it stuck.

zerkms avatar Aug 14 '19 02:08 zerkms

are you deploy kube in project default?

yosep08 avatar Sep 05 '19 08:09 yosep08

Nope, it runs in its own namespace

zerkms avatar Sep 05 '19 08:09 zerkms

kube ops view need resolve to kubernetes for collect data, so you can try can deploy kube ops in namespace default.

yosep08 avatar Sep 05 '19 08:09 yosep08

I have no problems running kubeops in general, this report was about a case when the backoff feature did not seem to work.

zerkms avatar Sep 05 '19 08:09 zerkms