Performance slow down between 1.8.5 and 1.9.2?

[alexhung]

Terraform Version

1.8.5 and 1.9.2

Terraform Configuration Files

N/A

Debug Output

N/A

Expected Behavior

Acceptance tests duration stays roughly the same.

Actual Behavior

Acceptance tests duration increased by 2x.

Steps to Reproduce

Execute my GitHub workflow acceptance test

Additional Context

Since Terraform 1.9.x, I noticed in our test suite that it nows executes around 2x slower.

With 1.8.5, it took around 19 min to complete all the acceptance testing:

With 1.9.2, now it took roughly twice as long:

GitHub workflow: https://github.com/jfrog/terraform-provider-artifactory/actions/workflows/acceptance-tests.yml

The pre-slowdown test run: https://github.com/jfrog/terraform-provider-artifactory/actions/runs/9701273096 PR: https://github.com/jfrog/terraform-provider-artifactory/pull/1008/files using Terraform 1.8.5

The next run: https://github.com/jfrog/terraform-provider-artifactory/actions/runs/9881625510 PR: https://github.com/jfrog/terraform-provider-artifactory/pull/1019/files using Terraform 1.9.2

References

No response

[jbardin]

Hi @alexhung,

Thanks for reporting this. I'm looking into it now, but not coming up with any timing differences through our usual collection of provider tests. Would it be possible to pick out a test scenario which shows a timing regression, and configure the same changes to be executed manually with terraform? That would eliminate any extra variables besides the core version, and make tracing any difference easier.

Thanks!

[alexhung]

@jbardin I tried to reproduce this locally (not on GitHub workflow) and have been unable to find any differences between Terraform 1.8.5, 1.9.3, or even OpenTofu 1.8.0.

Same subset of acceptance tests. This set takes around 220 seconds to complete locally. All three variations take about the same amount of time:

• 1.8.5 = 227.596s
• 1.9.3 = 226.488s
• tofu 1.8.0 = 227.472s

And yet, the GitHub workflow shows 2x differences. 😕

[liamcervante]

This might be a result of the security fix in https://github.com/hashicorp/terraform/releases/tag/v1.9.1. @alexhung, are you including timing of terraform init in your local runs and / or in the acceptance tests?

[alexhung]

@liamcervante The timings data above are from acceptance tests.

[jbardin]

Since we have not heard back in a while I'm going to close the issue. If you have any updates regarding the issue, feel free to open a new issue with the requested information. If you have more questions, you can also use the community forum where there are more people ready to help.

Thanks!

[github-actions[bot]]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.