crossplane icon indicating copy to clipboard operation
crossplane copied to clipboard

Poll with shorter intervals until the composites are ready to reduce TTR

Open turkenh opened this issue 1 year ago • 1 comments

What problem are you facing?

Observing significant delays (compared to actual MR provisioning time) before composite resources are marked as Ready especially when there are nested composite in the tree.

For example, in the example below, the only managed resource become ready in 40 secs but our parent composite is marked as ready around 2 minutes (see TTR)

Screenshot 2024-02-23 at 14 53 27

Reproduction manifests: https://github.com/turkenh/repro-xp-5424

How could Crossplane help solve your problem?

Today, in composite controllers, we return reconcile.Result{Requeue: true} until composites are ready which is subject to exponential backoff limited to 1m. I believe we can poll differently depending on readiness and check more frequently until the resource is ready, similar to how we did in provider kubernetes recently here.

Crossplane version: v1.15.0

turkenh avatar Feb 23 '24 11:02 turkenh

This is what I am seeing when I enable realtime compositions:

Screenshot 2024-02-23 at 15 03 53

FWIW, with more complex nested compositions I noticed that realtime composition was not this realtime though. Probably due to some rate-limiting.

turkenh avatar Feb 23 '24 12:02 turkenh