data-infra icon indicating copy to clipboard operation
data-infra copied to clipboard

Add Kuba DAG and tests

Open ohrite opened this issue 8 months ago • 1 comments

Description

Describe your changes and why you're making them. Please include the context, motivation, and relevant dependencies.

Resolves #[issue]

Type of change

  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [ ] New feature
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] Documentation

How has this been tested?

Include commands/logs/screenshots as relevant.

If making changes to dbt models, please run the command poetry run dbt run -s CHANGED_MODEL and poetry run dbt test -s CHANGED_MODEL, then include the output in this section of the PR.

Post-merge follow-ups

Document any actions that must be taken post-merge to deploy or otherwise implement the changes in this PR (for example, running a full refresh of some incremental model in dbt). If these actions will take more than a few hours after the merge or if they will be completed by someone other than the PR author, please create a dedicated follow-up issue and link it here to track resolution.

  • [ ] No action required
  • [ ] Actions required (specified below)

ohrite avatar Apr 30 '25 16:04 ohrite

Terraform plan in iac/cal-itp-data-infra/airflow/us

Plan: 2 to add, 14 to change, 16 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+   create
!~  update in-place
-   destroy

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-composer["dags/cosmos_nonpayment_dag.py"] will be destroyed
  # (because key ["dags/cosmos_nonpayment_dag.py"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "iIW6Cw==" -> null
-       detect_md5hash      = "2k0nIiXzwzBVuNWCKJN/EA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485819892067 -> null
-       id                  = "calitp-composer-dags/cosmos_nonpayment_dag.py" -> null
-       md5hash             = "2k0nIiXzwzBVuNWCKJN/EA==" -> null
-       md5hexhash          = "da4d272225f3c33055b8d58228937f10" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Fcosmos_nonpayment_dag.py?generation=1751485819892067&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/cosmos_nonpayment_dag.py" -> null
-       output_name         = "dags/cosmos_nonpayment_dag.py" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Fcosmos_nonpayment_dag.py" -> null
-       source              = "../../../../airflow/dags/cosmos_nonpayment_dag.py" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/cosmos_payment_dag.py"] will be destroyed
  # (because key ["dags/cosmos_payment_dag.py"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "XwE79g==" -> null
-       detect_md5hash      = "ruy3WFT/ywTuhBeF2hnumQ==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751416674363585 -> null
-       id                  = "calitp-composer-dags/cosmos_payment_dag.py" -> null
-       md5hash             = "ruy3WFT/ywTuhBeF2hnumQ==" -> null
-       md5hexhash          = "aeecb75854ffcb04ee841785da19ee99" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Fcosmos_payment_dag.py?generation=1751416674363585&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/cosmos_payment_dag.py" -> null
-       output_name         = "dags/cosmos_payment_dag.py" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Fcosmos_payment_dag.py" -> null
-       source              = "../../../../airflow/dags/cosmos_payment_dag.py" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/create_external_tables/ntd_report_validation/external_table_all_ntdreports.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer" {
!~      crc32c              = "kyf13Q==" -> (known after apply)
!~      detect_md5hash      = "kOync6eBJkdC0dW0Jzgtpg==" -> "different hash"
!~      generation          = 1751416672573885 -> (known after apply)
        id                  = "calitp-composer-dags/create_external_tables/ntd_report_validation/external_table_all_ntdreports.yml"
!~      md5hash             = "kOync6eBJkdC0dW0Jzgtpg==" -> (known after apply)
        name                = "dags/create_external_tables/ntd_report_validation/external_table_all_ntdreports.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/dbt_all_dag.py"] will be created
+   resource "google_storage_bucket_object" "calitp-composer" {
+       bucket         = "calitp-composer"
+       content        = (sensitive value)
+       content_type   = (known after apply)
+       crc32c         = (known after apply)
+       detect_md5hash = "different hash"
+       generation     = (known after apply)
+       id             = (known after apply)
+       kms_key_name   = (known after apply)
+       md5hash        = (known after apply)
+       md5hexhash     = (known after apply)
+       media_link     = (known after apply)
+       name           = "dags/dbt_all_dag.py"
+       output_name    = (known after apply)
+       self_link      = (known after apply)
+       source         = "../../../../airflow/dags/dbt_all_dag.py"
+       storage_class  = (known after apply)
    }

  # google_storage_bucket_object.calitp-composer["dags/dbt_payments_dag.py"] will be created
+   resource "google_storage_bucket_object" "calitp-composer" {
+       bucket         = "calitp-composer"
+       content        = (sensitive value)
+       content_type   = (known after apply)
+       crc32c         = (known after apply)
+       detect_md5hash = "different hash"
+       generation     = (known after apply)
+       id             = (known after apply)
+       kms_key_name   = (known after apply)
+       md5hash        = (known after apply)
+       md5hexhash     = (known after apply)
+       media_link     = (known after apply)
+       name           = "dags/dbt_payments_dag.py"
+       output_name    = (known after apply)
+       self_link      = (known after apply)
+       source         = "../../../../airflow/dags/dbt_payments_dag.py"
+       storage_class  = (known after apply)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse/METADATA.yml"] will be destroyed
  # (because key ["dags/transform_warehouse/METADATA.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "rTxPwQ==" -> null
-       detect_md5hash      = "gDxdrL5o3VaeoUG5BuT9MA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1752012774189228 -> null
-       id                  = "calitp-composer-dags/transform_warehouse/METADATA.yml" -> null
-       md5hash             = "gDxdrL5o3VaeoUG5BuT9MA==" -> null
-       md5hexhash          = "803c5dacbe68dd569ea141b906e4fd30" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2FMETADATA.yml?generation=1752012774189228&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse/METADATA.yml" -> null
-       output_name         = "dags/transform_warehouse/METADATA.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2FMETADATA.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse/METADATA.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse/README.md"] will be destroyed
  # (because key ["dags/transform_warehouse/README.md"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "N2yy8Q==" -> null
-       detect_md5hash      = "EXnXdklhVCT6NExeUhuCRw==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485820181121 -> null
-       id                  = "calitp-composer-dags/transform_warehouse/README.md" -> null
-       md5hash             = "EXnXdklhVCT6NExeUhuCRw==" -> null
-       md5hexhash          = "1179d77649615424fa344c5e521b8247" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2FREADME.md?generation=1751485820181121&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse/README.md" -> null
-       output_name         = "dags/transform_warehouse/README.md" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2FREADME.md" -> null
-       source              = "../../../../airflow/dags/transform_warehouse/README.md" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse/dbt_run_and_upload_artifacts.yml"] will be destroyed
  # (because key ["dags/transform_warehouse/dbt_run_and_upload_artifacts.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "BasEhQ==" -> null
-       detect_md5hash      = "eosxYzjG9L4u4S5IV0f/1A==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485819895635 -> null
-       id                  = "calitp-composer-dags/transform_warehouse/dbt_run_and_upload_artifacts.yml" -> null
-       md5hash             = "eosxYzjG9L4u4S5IV0f/1A==" -> null
-       md5hexhash          = "7a8b316338c6f4be2ee12e485747ffd4" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2Fdbt_run_and_upload_artifacts.yml?generation=1751485819895635&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse/dbt_run_and_upload_artifacts.yml" -> null
-       output_name         = "dags/transform_warehouse/dbt_run_and_upload_artifacts.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2Fdbt_run_and_upload_artifacts.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse/dbt_run_and_upload_artifacts.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse/dbt_test.yml"] will be destroyed
  # (because key ["dags/transform_warehouse/dbt_test.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "H4NkCg==" -> null
-       detect_md5hash      = "FouUSkAANNBrkR8YlEDyLA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751416675065888 -> null
-       id                  = "calitp-composer-dags/transform_warehouse/dbt_test.yml" -> null
-       md5hash             = "FouUSkAANNBrkR8YlEDyLA==" -> null
-       md5hexhash          = "168b944a400034d06b911f189440f22c" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2Fdbt_test.yml?generation=1751416675065888&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse/dbt_test.yml" -> null
-       output_name         = "dags/transform_warehouse/dbt_test.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse%2Fdbt_test.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse/dbt_test.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh/METADATA.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh/METADATA.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "pSESjw==" -> null
-       detect_md5hash      = "UgjlNpFGtU41GlVohkyE7g==" -> null
-       event_based_hold    = false -> null
-       generation          = 1752012774192605 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh/METADATA.yml" -> null
-       md5hash             = "UgjlNpFGtU41GlVohkyE7g==" -> null
-       md5hexhash          = "5208e5369146b54e351a5568864c84ee" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2FMETADATA.yml?generation=1752012774192605&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh/METADATA.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh/METADATA.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2FMETADATA.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh/METADATA.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh/README.md"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh/README.md"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "xka7Bg==" -> null
-       detect_md5hash      = "dfoFKUv8C4kOuPBSWmwNNQ==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485819895572 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh/README.md" -> null
-       md5hash             = "dfoFKUv8C4kOuPBSWmwNNQ==" -> null
-       md5hexhash          = "75fa05294bfc0b890eb8f0525a6c0d35" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2FREADME.md?generation=1751485819895572&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh/README.md" -> null
-       output_name         = "dags/transform_warehouse_full_refresh/README.md" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2FREADME.md" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh/README.md" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "DUC0og==" -> null
-       detect_md5hash      = "VyW21SypkxM2yjLri8T9Xw==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485820163563 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml" -> null
-       md5hash             = "VyW21SypkxM2yjLri8T9Xw==" -> null
-       md5hexhash          = "5725b6d52ca9931336ca32eb8bc4fd5f" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2Fdbt_run_and_upload_artifacts.yml?generation=1751485820163563&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2Fdbt_run_and_upload_artifacts.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh/dbt_run_and_upload_artifacts.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh/dbt_test.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh/dbt_test.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "q7AdIw==" -> null
-       detect_md5hash      = "7xSa1VEHgG31ghW+WD5pdw==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751416675246564 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh/dbt_test.yml" -> null
-       md5hash             = "7xSa1VEHgG31ghW+WD5pdw==" -> null
-       md5hexhash          = "ef149ad55107806df58215be583e6977" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2Fdbt_test.yml?generation=1751416675246564&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh/dbt_test.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh/dbt_test.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh%2Fdbt_test.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh/dbt_test.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/METADATA.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/METADATA.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "Cv1Cgw==" -> null
-       detect_md5hash      = "P5ABkJiLwJG1zwkpbZUgew==" -> null
-       event_based_hold    = false -> null
-       generation          = 1752012774457230 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/METADATA.yml" -> null
-       md5hash             = "P5ABkJiLwJG1zwkpbZUgew==" -> null
-       md5hexhash          = "3f900190988bc091b5cf09296d95207b" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2FMETADATA.yml?generation=1752012774457230&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/METADATA.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/METADATA.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2FMETADATA.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/METADATA.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/README.md"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/README.md"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "71fzIQ==" -> null
-       detect_md5hash      = "97NIfH78kp9Qsefw+S/xFA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485819861931 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/README.md" -> null
-       md5hash             = "97NIfH78kp9Qsefw+S/xFA==" -> null
-       md5hexhash          = "f7b3487c7efc929f50b1e7f0f92ff114" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2FREADME.md?generation=1751485819861931&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/README.md" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/README.md" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2FREADME.md" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/README.md" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "lpo4KQ==" -> null
-       detect_md5hash      = "t4dlQ4mkxjU6Cr2r/t7YGw==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485820121731 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml" -> null
-       md5hash             = "t4dlQ4mkxjU6Cr2r/t7YGw==" -> null
-       md5hexhash          = "b787654389a4c6353a0abdabfeded81b" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml?generation=1751485820121731&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_full_refresh_exclude_rt.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "ue2ydg==" -> null
-       detect_md5hash      = "GeCgM2T4uEKLSZGGNvpCUA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751485820197776 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml" -> null
-       md5hash             = "GeCgM2T4uEKLSZGGNvpCUA==" -> null
-       md5hexhash          = "19e0a03364f8b8428b49918636fa4250" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_run_and_upload_artifacts_select_rt.yml?generation=1751485820197776&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_run_and_upload_artifacts_select_rt.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/dbt_run_and_upload_artifacts_select_rt.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "MtpAFg==" -> null
-       detect_md5hash      = "V+KHT2/A37WtMuMEGGosxg==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751416670624725 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml" -> null
-       md5hash             = "V+KHT2/A37WtMuMEGGosxg==" -> null
-       md5hexhash          = "57e2874f6fc0dfb5ad32e304186a2cc6" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_test_exclude_rt.yml?generation=1751416670624725&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_test_exclude_rt.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/dbt_test_exclude_rt.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer["dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml"] will be destroyed
  # (because key ["dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-composer" {
-       bucket              = "calitp-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "1zJXSA==" -> null
-       detect_md5hash      = "QMcwLpE+GqH075eTyG9vPQ==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751416671149499 -> null
-       id                  = "calitp-composer-dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml" -> null
-       md5hash             = "QMcwLpE+GqH075eTyG9vPQ==" -> null
-       md5hexhash          = "40c7302e913e1aa1f4ef9793c86f6f3d" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_test_select_rt.yml?generation=1751416671149499&alt=media" -> null
-       metadata            = {} -> null
-       name                = "dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml" -> null
-       output_name         = "dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-composer/o/dags%2Ftransform_warehouse_full_refresh_sunday%2Fdbt_test_select_rt.yml" -> null
-       source              = "../../../../airflow/dags/transform_warehouse_full_refresh_sunday/dbt_test_select_rt.yml" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["macros/generate_schema_name.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "a6qEjw==" -> (known after apply)
!~      detect_md5hash      = "bZhhIVi3qA4oUdmiy2tAIg==" -> "different hash"
!~      generation          = 1751416669920932 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/macros/generate_schema_name.sql"
!~      md5hash             = "bZhhIVi3qA4oUdmiy2tAIg==" -> (known after apply)
        name                = "data/warehouse/macros/generate_schema_name.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/mart/transit_database/_mart_transit_database.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "QoKcqw==" -> (known after apply)
!~      detect_md5hash      = "lwBJGWlYO9CAEOFubaQp3g==" -> "different hash"
!~      generation          = 1752188818477366 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
!~      md5hash             = "lwBJGWlYO9CAEOFubaQp3g==" -> (known after apply)
        name                = "data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__calendar_year_vrm.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "pQ+6Gw==" -> (known after apply)
!~      detect_md5hash      = "uoJcsAS+b9OHkcIG4Hoavw==" -> "different hash"
!~      generation          = 1751416662596405 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__calendar_year_vrm.sql"
!~      md5hash             = "uoJcsAS+b9OHkcIG4Hoavw==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__calendar_year_vrm.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "aB4j4g==" -> (known after apply)
!~      detect_md5hash      = "YHPxjewpSY1v2/Tq1tfVFg==" -> "different hash"
!~      generation          = 1751416662435094 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt.sql"
!~      md5hash             = "YHPxjewpSY1v2/Tq1tfVFg==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt_estimates.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "9EhsoQ==" -> (known after apply)
!~      detect_md5hash      = "zri9DBXNFe9fsqFqNErzQA==" -> "different hash"
!~      generation          = 1751416668312336 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt_estimates.sql"
!~      md5hash             = "zri9DBXNFe9fsqFqNErzQA==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__upt_estimates.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__voms.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "SSsyWw==" -> (known after apply)
!~      detect_md5hash      = "PFvrm4+OiHYAfG6jyeZc5A==" -> "different hash"
!~      generation          = 1751416664245306 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__voms.sql"
!~      md5hash             = "PFvrm4+OiHYAfG6jyeZc5A==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__voms.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrh.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "H6wSOw==" -> (known after apply)
!~      detect_md5hash      = "wO8AxlLwRDSsVsORo5DW4A==" -> "different hash"
!~      generation          = 1751416669570436 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrh.sql"
!~      md5hash             = "wO8AxlLwRDSsVsORo5DW4A==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrh.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "jkhBJw==" -> (known after apply)
!~      detect_md5hash      = "cA+9ZlTjY8K2xJyrRYdwXA==" -> "different hash"
!~      generation          = 1751416670298385 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm.sql"
!~      md5hash             = "cA+9ZlTjY8K2xJyrRYdwXA==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm_estimates.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "vCyQTw==" -> (known after apply)
!~      detect_md5hash      = "4v2b6TzsKvg4icifUpRWtw==" -> "different hash"
!~      generation          = 1751416666760043 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm_estimates.sql"
!~      md5hash             = "4v2b6TzsKvg4icifUpRWtw==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_ridership/stg_ntd__complete_monthly_ridership_with_adjustments_and_estimates__vrm_estimates.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_validation/stg_ntd_a10.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "Q8YFng==" -> (known after apply)
!~      detect_md5hash      = "0s0MTUGZ1t0N5sZIGXIdYQ==" -> "different hash"
!~      generation          = 1751416661740937 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_validation/stg_ntd_a10.sql"
!~      md5hash             = "0s0MTUGZ1t0N5sZIGXIdYQ==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_validation/stg_ntd_a10.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_validation/stg_ntd_rr20_rural.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "kVHSrg==" -> (known after apply)
!~      detect_md5hash      = "qejbYmyNqLPOHPszELmNcA==" -> "different hash"
!~      generation          = 1751416670058015 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_validation/stg_ntd_rr20_rural.sql"
!~      md5hash             = "qejbYmyNqLPOHPszELmNcA==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_validation/stg_ntd_rr20_rural.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/ntd_validation/stg_ntd_rr20_urban_tribal.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "8B7DKQ==" -> (known after apply)
!~      detect_md5hash      = "nA/3GlgjO7TcO6VP7GcLAQ==" -> "different hash"
!~      generation          = 1751416661289076 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/ntd_validation/stg_ntd_rr20_urban_tribal.sql"
!~      md5hash             = "nA/3GlgjO7TcO6VP7GcLAQ==" -> (known after apply)
        name                = "data/warehouse/models/staging/ntd_validation/stg_ntd_rr20_urban_tribal.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-partial_parse will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-partial_parse" {
!~      content             = (sensitive value)
!~      crc32c              = "OzNfuQ==" -> (known after apply)
!~      detect_md5hash      = "gQDYRjFTdm3tOMNXeu84Og==" -> "different hash"
!~      generation          = 1752010341206630 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/target/partial_parse.msgpack"
!~      md5hash             = "gQDYRjFTdm3tOMNXeu84Og==" -> (known after apply)
        name                = "data/warehouse/target/partial_parse.msgpack"
#        (16 unchanged attributes hidden)
    }

Plan: 2 to add, 14 to change, 16 to destroy.

:x: Plan not applied in Apply Airflow DAGs #49 (Plan has changed)

github-actions[bot] avatar Jul 16 '25 19:07 github-actions[bot]

Terraform plan in iac/cal-itp-data-infra-staging/airflow/us

Plan: 1 to add, 5 to change, 3 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+   create
!~  update in-place
-   destroy

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-staging-composer["plugins/hooks/transitland_hook.py"] will be created
+   resource "google_storage_bucket_object" "calitp-staging-composer" {
+       bucket         = "calitp-staging-composer"
+       content        = (sensitive value)
+       content_type   = (known after apply)
+       crc32c         = (known after apply)
+       detect_md5hash = "different hash"
+       generation     = (known after apply)
+       id             = (known after apply)
+       kms_key_name   = (known after apply)
+       md5hash        = (known after apply)
+       md5hexhash     = (known after apply)
+       media_link     = (known after apply)
+       name           = "plugins/hooks/transitland_hook.py"
+       output_name    = (known after apply)
+       self_link      = (known after apply)
+       source         = "../../../../airflow/plugins/hooks/transitland_hook.py"
+       storage_class  = (known after apply)
    }

  # google_storage_bucket_object.calitp-staging-composer["plugins/libs/__init__.py"] will be destroyed
  # (because key ["plugins/libs/__init__.py"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-staging-composer" {
-       bucket              = "calitp-staging-composer" -> null
-       content_type        = "text/plain; charset=utf-8" -> null
-       crc32c              = "AAAAAA==" -> null
-       detect_md5hash      = "1B2M2Y8AsgTpgAmY7PhCfg==" -> null
-       event_based_hold    = false -> null
-       generation          = 1751950420136018 -> null
-       id                  = "calitp-staging-composer-plugins/libs/__init__.py" -> null
-       md5hash             = "1B2M2Y8AsgTpgAmY7PhCfg==" -> null
-       md5hexhash          = "d41d8cd98f00b204e9800998ecf8427e" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-staging-composer/o/plugins%2Flibs%2F__init__.py?generation=1751950420136018&alt=media" -> null
-       metadata            = {} -> null
-       name                = "plugins/libs/__init__.py" -> null
-       output_name         = "plugins/libs/__init__.py" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-staging-composer/o/plugins%2Flibs%2F__init__.py" -> null
-       source              = "../../../../airflow/plugins/libs/__init__.py" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer["plugins/operators/aggregator_to_gcs_operator.py"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer" {
!~      crc32c              = "ig+/LA==" -> (known after apply)
!~      detect_md5hash      = "XJkgbCLPyivP+4iiIstZYw==" -> "different hash"
!~      generation          = 1752098038059693 -> (known after apply)
        id                  = "calitp-staging-composer-plugins/operators/aggregator_to_gcs_operator.py"
!~      md5hash             = "XJkgbCLPyivP+4iiIstZYw==" -> (known after apply)
        name                = "plugins/operators/aggregator_to_gcs_operator.py"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-catalog will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-catalog" {
!~      content             = (sensitive value)
!~      crc32c              = "WRdFpA==" -> (known after apply)
!~      detect_md5hash      = "sXixJ7yd0a/nE3vZFh+ZxQ==" -> "different hash"
!~      generation          = 1752627600778857 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/catalog.json"
!~      md5hash             = "sXixJ7yd0a/nE3vZFh+ZxQ==" -> (known after apply)
        name                = "data/warehouse/target/catalog.json"
#        (16 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["macros/.DS_Store"] will be destroyed
  # (because key ["macros/.DS_Store"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
-       bucket              = "calitp-staging-composer" -> null
-       content_type        = "application/octet-stream" -> null
-       crc32c              = "sYtuGQ==" -> null
-       detect_md5hash      = "GUV3p+IL3Mevu3GPUCwTTA==" -> null
-       event_based_hold    = false -> null
-       generation          = 1752622237777318 -> null
-       id                  = "calitp-staging-composer-data/warehouse/macros/.DS_Store" -> null
-       md5hash             = "GUV3p+IL3Mevu3GPUCwTTA==" -> null
-       md5hexhash          = "194577a7e20bdcc7afbb718f502c134c" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-staging-composer/o/data%2Fwarehouse%2Fmacros%2F.DS_Store?generation=1752622237777318&alt=media" -> null
-       metadata            = {} -> null
-       name                = "data/warehouse/macros/.DS_Store" -> null
-       output_name         = "data/warehouse/macros/.DS_Store" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-staging-composer/o/data%2Fwarehouse%2Fmacros%2F.DS_Store" -> null
-       source              = "../../../../warehouse/macros/.DS_Store" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["tests/.DS_Store"] will be destroyed
  # (because key ["tests/.DS_Store"] is not in for_each map)
-   resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
-       bucket              = "calitp-staging-composer" -> null
-       content_type        = "application/octet-stream" -> null
-       crc32c              = "s+mJiQ==" -> null
-       detect_md5hash      = "oKfMIt6AQAIL99uaN6y/2Q==" -> null
-       event_based_hold    = false -> null
-       generation          = 1752622237417562 -> null
-       id                  = "calitp-staging-composer-data/warehouse/tests/.DS_Store" -> null
-       md5hash             = "oKfMIt6AQAIL99uaN6y/2Q==" -> null
-       md5hexhash          = "a0a7cc22de8040020bf7db9a37acbfd9" -> null
-       media_link          = "https://storage.googleapis.com/download/storage/v1/b/calitp-staging-composer/o/data%2Fwarehouse%2Ftests%2F.DS_Store?generation=1752622237417562&alt=media" -> null
-       metadata            = {} -> null
-       name                = "data/warehouse/tests/.DS_Store" -> null
-       output_name         = "data/warehouse/tests/.DS_Store" -> null
-       self_link           = "https://www.googleapis.com/storage/v1/b/calitp-staging-composer/o/data%2Fwarehouse%2Ftests%2F.DS_Store" -> null
-       source              = "../../../../warehouse/tests/.DS_Store" -> null
-       storage_class       = "STANDARD" -> null
-       temporary_hold      = false -> null
#        (6 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-index will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-index" {
!~      content             = (sensitive value)
!~      crc32c              = "IpZIrQ==" -> (known after apply)
!~      detect_md5hash      = "UfZomGsHk2apMVHrXXaXuw==" -> "different hash"
!~      generation          = 1752627599721754 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/index.html"
!~      md5hash             = "UfZomGsHk2apMVHrXXaXuw==" -> (known after apply)
        name                = "data/warehouse/target/index.html"
#        (16 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-manifest will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-manifest" {
!~      content             = (sensitive value)
!~      crc32c              = "5ltfmg==" -> (known after apply)
!~      detect_md5hash      = "dMJIzgxhhvznYK3+LzYw9Q==" -> "different hash"
!~      generation          = 1752627602502369 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/manifest.json"
!~      md5hash             = "dMJIzgxhhvznYK3+LzYw9Q==" -> (known after apply)
        name                = "data/warehouse/target/manifest.json"
#        (16 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-partial_parse will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-partial_parse" {
!~      content             = (sensitive value)
!~      crc32c              = "KLLQ5g==" -> (known after apply)
!~      detect_md5hash      = "VbpK1LXbULgS2hM9OUtXgA==" -> "different hash"
!~      generation          = 1752629646479639 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/partial_parse.msgpack"
!~      md5hash             = "VbpK1LXbULgS2hM9OUtXgA==" -> (known after apply)
        name                = "data/warehouse/target/partial_parse.msgpack"
#        (16 unchanged attributes hidden)
    }

Plan: 1 to add, 5 to change, 3 to destroy.

:memo: Plan generated in Plan Airflow DAGs #329

github-actions[bot] avatar Jul 16 '25 19:07 github-actions[bot]