ConfigureProvider very slow (8-9s)

[t0yv0]

What happened?

When we benchmark pulumi-azure classic templates in pulumi/templates, noticing that ConfigureProvider is unusually slow.

https://github.com/pulumi/templates/actions/runs/3067677832/jobs/4954218825

Sample of millisecond timings of ConfigureProvider as reported by the tracing span:

9671
7935
8753
9227
7776
7002
8660
10065
7830
7614
8276
8884
9576
7627
8866
8707
8914
7795
9208
9002
7624
9349
8548
7318

Other providers finish ConfigureProvider within 1s.

Steps to reproduce

Checkout pulumi/templates.

Run:

make bench_template.azure-classic-go                                                                                                                                                                   

View the trace

PULUMI_DEBUG_COMMANDS=1 pulumi view-trace ./traces/azure-classic-go-pulumi-update-initial.trace

Observe the ConfigureProvider span in the trace. One of my samples showed 14s.

Expected Behavior

ConfigureProvider finishes <1s

Actual Behavior

ConfigureProvider takes up to 10s.

Output of pulumi about

CLI          
Version      3.40.0
Go Version   go1.19
Go Compiler  gc

Host     
OS       darwin
Version  12.5.1
Arch     x86_64

Backend        
Name           pulumi.com
URL            https://app.pulumi.com/t0yv0
User           t0yv0
Organizations  t0yv0, pulumi

Pulumi locates its logs in /var/folders/mb/s1jx27m10t3082fqclpgytt80000gn/T/ by default

Additional context

No response

Contributing

Vote on this issue by adding a 👍 reaction. To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

[stack72]

@t0yv0 are you expecting anything from us here or is this something you opened for yourself?

[t0yv0]

I do not currently have a good tooling and understanding to investigate why this is the case. It can wait in the backlog perhaps unless you have an idea of how this can be improved.