helm-charts icon indicating copy to clipboard operation
helm-charts copied to clipboard

Pod "CrashLoopBackOff" after upgrade to 1.66.2

Open pollynesterovich opened this issue 3 years ago • 3 comments

After trying to upgrade vmagent from version 1.63.0 to 1.66.2, the pod crashes constantly "CrashLoopBackOff". There are no errors in the logs, the pod dies due to oom. Optimal memory and processor limits set. There were no such problems before the upgrade. Please tell me what is the reason for the increase in resources for consumption and how to fix it in order to switch to the new version of vmagent?

pollynesterovich avatar Sep 27 '21 17:09 pollynesterovich

Can you temporary increase memory limit until it doesn't crash. Then collect memory profile according to doc https://docs.victoriametrics.com/#profiling

And attach it to this issue?

Memory profile for 1.63.0 version will be useful as well.

f41gh7 avatar Sep 27 '21 22:09 f41gh7

We tested upgrading to 1.65.0 and everything works fine, but problems with v1.66.0-1.66.2.

1.63.0.zip 1.66.0.zip

pollynesterovich avatar Sep 28 '21 13:09 pollynesterovich

Please tell me when the answer will be given, the memory usage when upgrading to 1.66 or 1.67 versions has almost doubled, how can I fix this?

pollynesterovich avatar Oct 19 '21 16:10 pollynesterovich