source-controller icon indicating copy to clipboard operation
source-controller copied to clipboard

reconciliation for git source stuck with growing `workqueue_unfinished_work_seconds`

Open ndemeshchenko opened this issue 3 months ago • 1 comments

Hi, On my flux installation in AWS EKS, version

flux: v2.1.2
helm-controller: v0.36.2
image-automation-controller: v0.27.0
image-reflector-controller: v0.23.0
kustomize-controller: v1.1.1
notification-controller: v1.1.0
source-controller: v1.1.2

periodically I see source-controller being stuck and not completing/starting any reconciliation on git sources, while helm sources seems running fine.

I can't find anything in the source controller log during the time or before workqueue_unfinished_work_seconds starting to grow.

image

Any pointers on where to look to find a solution? Or what information might help to dig deeper

ndemeshchenko avatar Apr 04 '24 12:04 ndemeshchenko