dbt-core icon indicating copy to clipboard operation
dbt-core copied to clipboard

Replace DBT_EXPERIMENTAL_MICROBATCH env var with behaviour flag

Open MichelleArk opened this issue 1 year ago • 0 comments

Prior to the 1.9 beta, we should:

  1. Replace usage of env var DBT_EXPERIMENTAL_MICROBATCH with a project flag, require_builtin_microbatch_strategy which defaults to False (@graciegoheen approves the name :) )

  2. Make changes to dbt-adapters:

  1. Make changes to dbt-bigquery:
  • a couple additional tests have been added beyond the base test the additional tests patch the os env var directly
  • https://github.com/dbt-labs/dbt-bigquery/blob/main/tests/functional/adapter/incremental/test_incremental_microbatch.py#L33
  • https://github.com/dbt-labs/dbt-bigquery/blob/main/tests/functional/adapter/incremental/test_incremental_microbatch.py#L48 they'll need to be updated to use the project_config_update fixture instead

dbt-postgres and dbt-snowflake use the base test only and don't need any manual updates

MichelleArk avatar Sep 30 '24 18:09 MichelleArk