scheduled-scaler icon indicating copy to clipboard operation
scheduled-scaler copied to clipboard

Seeing issues with resource versions

Open ericuldall opened this issue 6 years ago • 5 comments

The following error is popping up in logs and may be causing some unknown issues:

I0622 12:00:00.015384       1 scaling-controller.go:118] FAILED TO UPDATE SCHEDULED SCALER STATUS: [HPA_NAME] - Operation cannot be fulfilled on scheduledscalers.scaling.k8s.restdev.com "[HPA_NAME]": the object has been modified; please apply your changes to the latest version and try again

Needs further investigation.

ericuldall avatar Jun 25 '18 17:06 ericuldall

Just ran a couple tests in my GKE server and the updates appear to be working even though the error is thrown. I'll keep an eye on this for now and see about getting the errors resolved when I have some time.

ericuldall avatar Jun 25 '18 17:06 ericuldall

we see this error quite a bit .. what happens as a result is very bad -- the schedule just doesn't kick in and we miss critical windows where production services are not scaled to the appropriate capacity levels.. we've taken a look at our processes and have not been able to track down what causes this in all cases

Could the issue be due to the fairly outdated version of the kube client package?

m0rganic avatar May 01 '20 19:05 m0rganic

It's possible. Perhaps newer changes to the api have created an adverse side effect that wasn't present on previous tests. The package has not been updated for latest versions of kubes either.

ericuldall avatar May 03 '20 09:05 ericuldall

Does #29 fix this?

scr-oath avatar Nov 18 '20 19:11 scr-oath

@m0rganic @ericuldall have you both resolved this as I'm observing this issue in EKS.

guongle-ssense avatar Oct 19 '21 22:10 guongle-ssense