terraform-provider-rediscloud icon indicating copy to clipboard operation
terraform-provider-rediscloud copied to clipboard

database datasources makes many api calls to to rediscloud, causing rate limiting

Open atsui-bay1 opened this issue 5 months ago • 0 comments

Affected Resource(s)

Please list the resources as a list, for example:

  • rediscloud_active_active_subscription_database
  • rediscloud_database

Terraform Configuration Files

data "rediscloud_active_active_subscription_database" "subscription" {
  name     = "my-subscription"
}

Debug Output

https://gist.github.com/atsui-bay1/02029712d573cc046f3f845ef303a585

This output is for many rediscloud resources, so it may indicate that other datasources are also making multiple rediscloud calls

Expected Behavior

We run many terraform deployments in parallel, each of which may contain multiple redis databases. When updating ~20 databases, these datasources caused us to hit the 400 req/min rate limit. Most calls seem to be executing requests on to /v1/tasks to get databaseImportStatusRequest.

I understand that the provider is limited to what API is exposed on RedisCloud, but it may be helpful to allow the datasource to be configured for returning less information to reduce the overall number of calls.

Actual Behavior

What actually happened?

Steps to Reproduce

Please list the steps required to reproduce the issue, for example:

  1. terraform apply

atsui-bay1 avatar Aug 28 '24 01:08 atsui-bay1