kustomize-controller icon indicating copy to clipboard operation
kustomize-controller copied to clipboard

kustomize-controller hangs frequently

Open annaken opened this issue 1 year ago • 22 comments

We use flux in 5 clusters, and in just one of them (the newest, smallest one) the kustomize controller keeps hanging so bad I have to kill the pod. I don't see anything interesting in the logs before this happens, and otherwise there's no difference between this and other deploys. I upgraded to the latest version, but still seeing the same behaviour.

$ kubectl -n flux-system exec -it source-controller-7b66c9d497-r4d68 -- sh
~ $ du -sh /data/*
3.9M	/data/gitrepository

As it hangs, I see CPU max out at 1.5GB. NB in all of the clusters I've had to increase the ~memory~CPU requests and limits to around 1.2/1.5GB, but only in this cluster does the controller hang.

annaken avatar Dec 15 '22 10:12 annaken