terragrunt
terragrunt copied to clipboard
Missing required GCS remote state configuration project
I migrated your terragrunt live example git project to my needs as bellow(very simple changes): infra.zip
By manually creating the bucket, the error is gone. So Terragrunt is not creating the bucket automatically. Is it issue or ok?
But when I try to run either both modules or single one I still get above error, but all files are generated in cache subfolders, like this:
# Generated by Terragrunt. Sig: nIlQXj57tbuaRZEa
terraform {
backend "gcs" {
bucket = "prokyon-systems-state-bucket"
credentials = "/home/zangetsu/.config/gcloud/auto-accountant-3e24cb383cb7.json"
prefix = "terraform/state"
}
Debug output:
[16:48:18] zangetsu@zeus $ /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket master terragrunt plan --terragrunt-log-level debug --terragrunt-debug
DEBU[0000] Did not find any locals block: skipping evaluation.
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 1): source_source_url, version, environment_vars
DEBU[0000] Evaluated 1 locals (remaining 0): env
DEBU[0000] [Partial] Included config /data/proj/prokyon-systems/auto-accountant/infra/_envcommon/storage-bucket.hcl has strategy shallow merge: merging config in (shallow).
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_profile, google_project prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_zone, google_region prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 3): project_vars, region_vars, environment_vars
DEBU[0000] Evaluated 3 locals (remaining 0): project, region, zone
DEBU[0000] [Partial] Included config /data/proj/prokyon-systems/auto-accountant/infra/terragrunt.hcl has strategy shallow merge: merging config in (shallow).
DEBU[0000] Running command: terraform --version prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0000] Terraform version: 1.0.8
DEBU[0000] Reading Terragrunt config file at /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/terragrunt.hcl
DEBU[0000] Did not find any locals block: skipping evaluation.
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 1): source_source_url, version, environment_vars
DEBU[0000] Evaluated 1 locals (remaining 0): env
DEBU[0000] [Partial] Included config /data/proj/prokyon-systems/auto-accountant/infra/_envcommon/storage-bucket.hcl has strategy shallow merge: merging config in (shallow).
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_zone, google_region prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_profile, google_project prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 3 locals (remaining 3): region_vars, environment_vars, project_vars
DEBU[0000] Evaluated 3 locals (remaining 0): project, region, zone
DEBU[0000] [Partial] Included config /data/proj/prokyon-systems/auto-accountant/infra/terragrunt.hcl has strategy shallow merge: merging config in (shallow).
DEBU[0000] Did not find any locals block: skipping evaluation.
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 1): source_source_url, version, environment_vars
DEBU[0000] Evaluated 1 locals (remaining 0): env
DEBU[0000] Included config /data/proj/prokyon-systems/auto-accountant/infra/_envcommon/storage-bucket.hcl has strategy shallow merge: merging config in (shallow) for dependency.
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_zone, google_region prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_profile, google_project prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 3 locals (remaining 3): region_vars, environment_vars, project_vars
DEBU[0000] Evaluated 3 locals (remaining 0): project, region, zone
DEBU[0000] Included config /data/proj/prokyon-systems/auto-accountant/infra/terragrunt.hcl has strategy shallow merge: merging config in (shallow) for dependency.
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 1): environment_vars, source_source_url, version
DEBU[0000] Evaluated 1 locals (remaining 0): env
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 1): version, environment_vars, source_source_url
DEBU[0000] Evaluated 1 locals (remaining 0): env
DEBU[0000] Included config /data/proj/prokyon-systems/auto-accountant/infra/_envcommon/storage-bucket.hcl has strategy shallow merge: merging config in (shallow).
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 3): project_vars, region_vars, environment_vars
DEBU[0000] Evaluated 3 locals (remaining 0): zone, project, region
DEBU[0000] Found locals block: evaluating the expressions.
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Evaluated 2 locals (remaining 0): google_project, google_profile prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Evaluated 2 locals (remaining 0): google_region, google_zone prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Found locals block: evaluating the expressions. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 1 locals (remaining 0): environment prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev]
DEBU[0000] Evaluated 3 locals (remaining 3): project_vars, region_vars, environment_vars
DEBU[0000] Evaluated 3 locals (remaining 0): project, region, zone
DEBU[0000] Included config /data/proj/prokyon-systems/auto-accountant/infra/terragrunt.hcl has strategy shallow merge: merging config in (shallow).
WARN[0000] No double-slash (//) found in source URL /terraform-google-modules/terraform-google-cloud-storage.git. Relative paths in downloaded Terraform code may not work.
DEBU[0000] Downloading Terraform configurations from git::ssh://[email protected]/terraform-google-modules/terraform-google-cloud-storage.git?ref=v2.2.0 into /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc
DEBU[0002] Copying files from /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket into /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc
DEBU[0002] Setting working directory to /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc
DEBU[0002] Generated file /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc/provider.tf. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] Generated file /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc/backend.tf. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
INFO[0002] Debug mode requested: generating debug file terragrunt-debug.tfvars.json in working dir /data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] The following variables were detected in the terraform module: prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] [project_id prefix names force_destroy bucket_policy_only bucket_hmac_key_admins location set_storage_admin_roles set_viewer_roles cors website versioning creators labels logging randomize_suffix set_admin_roles set_hmac_key_admin_roles bucket_viewers lifecycle_rules retention_policy bucket_creators bucket_storage_admins set_creator_roles hmac_key_admins bucket_admins folders storage_class viewers storage_admins admins encryption_key_names] prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] WARN: The variable environment was omitted because it is not defined in the terraform module. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] WARN: The variable google_region was omitted because it is not defined in the terraform module. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] WARN: The variable google_zone was omitted because it is not defined in the terraform module. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] WARN: The variable google_profile was omitted because it is not defined in the terraform module. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] WARN: The variable google_project was omitted because it is not defined in the terraform module. prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] Variables passed to terraform are located in "/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/terragrunt-debug.tfvars.json" prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] Run this command to replicate how terraform was invoked: prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] terraform plan -var-file="/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/terragrunt-debug.tfvars.json" "/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket/.terragrunt-cache/ZPQIXSfOPRsWra9lxz6oufXjReU/ylK3MqXEMBo6iCF8m1qEZUHMXEc" prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] Initializing remote state for the gcs backend prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
DEBU[0002] Remote state GCS bucket prokyon-systems-state-bucket does not exist. Attempting to create it prefix=[/data/proj/prokyon-systems/auto-accountant/infra/non-prod/europe-central/dev/storage-bucket]
ERRO[0002] Missing required GCS remote state configuration project
ERRO[0002] Unable to determine underlying exit code, so Terragrunt will exit with error code 1
I think this is bug as soon as following statement: disable_init (attribute): When true, skip automatic initialization of the backend by Terragrunt. Some backends have support in Terragrunt to be automatically created if the storage does not exist. Currently s3 and gcs are the two backends with support for automatic creation. Defaults to false.
I don't configure this, so I would expect terragrunt to create the backend for me, but its failing instead. I have latest terragrunt and terraform versions as of today
I had to set the location in the config.
remote_state {
backend = "gcs"
config = {
project = "my-terraform"
location = "eu"
bucket = "my-terraform-state"
prefix = "${path_relative_to_include()}/terraform.tfstate"
gcs_bucket_labels = {
owner = "terragrunt_test"
name = "terraform_state_storage"
}
}
}