telemetry-airflow icon indicating copy to clipboard operation
telemetry-airflow copied to clipboard

DENG-2928: Merged publish_bqetl_static dag into bqetl_artifact_deployment dag

Open wwyc opened this issue 5 months ago • 1 comments

Decision has been made to use metadata.yaml files instead of description.txt for static tables. As a result, the static tables will rely on publish metadata job to publish metadata.

See related change in bqetl-etl repo: https://github.com/mozilla/bigquery-etl/pull/5105

The publish_bqetl_static DAG should be paused prior to merging this PR and deleted once the changes run successfully.

wwyc avatar Mar 01 '24 20:03 wwyc

The publish_bqetl_static DAG should be paused prior to merging this PR and deleted once the changes run successfully.

As it stands, I believe merging this PR would delete the publish_bqetl_static DAG from WTMO.

sean-rose avatar Mar 04 '24 17:03 sean-rose

Closing this PR as the preference is to keep the two separate: https://github.com/mozilla/bigquery-etl/pull/5105#discussion_r1509724442

wwyc avatar Apr 10 '24 23:04 wwyc