provider-helm icon indicating copy to clipboard operation
provider-helm copied to clipboard

Scalability: support --max-reconcile-rate

Open gberche-orange opened this issue 2 years ago • 0 comments

What problem are you facing?

From https://crossplane.slack.com/archives/CEG3T90A1/p1647335790153809?thread_ts=1647335364.461669&cid=CEG3T90A1:

I'm observing that a single XRC with a composition provisionning 4 kubernetes provider Objects is taking ~30-60s to become ready on a fresh empty K8S cluster. When there is an set of existing 300 XRCs already reconciled, then a new XRC reconciles in 30 minutes on my cluster. I'm running latest versions (crossplane 1.6.4 with helm provider 0.10 and kubernes provider 0.10.0) with the --max-reconcile-rate=100 arg in the helm chart.

How could Crossplane help solve your problem?

From https://github.com/crossplane/crossplane/issues/2595#issuecomment-983166375, the helm and kubernetes providers don't yet support the max reconcile rate option. Helm provider defaults to 10 set in https://github.com/crossplane-contrib/provider-helm/pull/53

Support for the --max-reconcile-rate would enable concurrent parallel processing of helm Release MRs

gberche-orange avatar Mar 15 '22 09:03 gberche-orange