elementary icon indicating copy to clipboard operation
elementary copied to clipboard

Concurrent DBT jobs are failing on populating elementary tables in GCPBQ

Open ATD-Vtippireddy opened this issue 7 months ago • 3 comments

Describe the bug Transaction is aborted due to concurrent update against table atd-cdp-prod:elementary.dbt_models. Transaction ID: 68381985-0000-235c-aa1e-089e0822be6c

To Reproduce Run the parallel jobs with Elementary enabled

Expected behavior We should not get the transaction concurrency issues

Screenshots If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

packages:

  • package: dbt-labs/codegen version: 0.12.1
  • package: brooklyn-data/dbt_artifacts version: 2.6.3
  • package: dbt-labs/dbt_utils version: 1.2.0
  • package: elementary-data/elementary version: 0.15.2

debug (60).log

Additional context Add any other context about the problem here.

Would you be willing to contribute a fix for this issue? Let us know if you're willing to contribute so that we'll be able to provide guidance.

ATD-Vtippireddy avatar May 20 '25 10:05 ATD-Vtippireddy

Hey @ATD-Vtippireddy ! First, we recommend upgrading the Elementary versions to dbt package 0.18.2 and CLI 0.18.1 😄 Please see our docs for help with this.

NoyaOffer avatar May 20 '25 10:05 NoyaOffer

I have upgraded in non prod environment, So you meant post this upgrade the issue which we are facing will not occur? As I could see post upgrade also i noticing the same sql of Elementray is being executed i do not see any change before and after upgrade

ATD-Vtippireddy avatar May 20 '25 18:05 ATD-Vtippireddy

This issue is stale because it has been open for too long with no activity. If you would like the issue to remain open, please remove the stale label or leave a comment.

github-actions[bot] avatar Nov 15 '25 02:11 github-actions[bot]