bdit_data-sources icon indicating copy to clipboard operation
bdit_data-sources copied to clipboard

#1051 delete deprecated collisions / traffic pipelines

Open gabrielwol opened this issue 5 months ago • 0 comments

What this pull request accomplishes:

  • Delete dags/traffic_transfer.py, dags/collisions_replicator_transfer.py and all the SQL functions / tables they maintained.
  • Fix one view that's not broken but had name inconsistent with definition in github

Issue(s) this solves:

  • Closes #1051

What, in particular, needs to reviewed:

What needs to be done by a sysadmin after this PR is merged

Need to:

--these are the functions from the DAGs
DROP FUNCTION IF EXISTS collisions_replicator.refresh_mat_view_collisions_no;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_mat_views;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_ev_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_inv_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_norm_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_raw_fields_mv;
DROP FUNCTION IF EXISTS collisions_replicator.update_acc_safe_copy;
DROP FUNCTION IF EXISTS traffic.update_arc_link;
DROP FUNCTION IF EXISTS traffic.update_arterydata;
DROP FUNCTION IF EXISTS traffic.update_category;
DROP FUNCTION IF EXISTS traffic.update_cnt_det;
DROP FUNCTION IF EXISTS traffic.update_cnt_spd;
DROP FUNCTION IF EXISTS traffic.update_countinfo;
DROP FUNCTION IF EXISTS traffic.update_countinfomics;
DROP FUNCTION IF EXISTS traffic.update_det;
DROP FUNCTION IF EXISTS traffic.update_node;

--do not use views in traffic
DROP VIEW IF EXISTS traffic.artery_traffic_signals_DO_NOT_USE;
DROP VIEW IF EXISTS traffic.artery_locations_px_DO_NOT_USE; --this one is referenced by two DRs which we would have to deal with: data_requests.i0510_nycs_volume_tmc, data_requests.i0648_glencarin_tmc

--logged actions, no longer relevant with current truncate and delete paradigm. 
DROP TABLE IF EXISTS traffic.logged_actions;
DROP FUNCTION IF EXISTS traffic.if_modified_func();

gabrielwol avatar Aug 28 '24 20:08 gabrielwol