Natalie
Natalie
eoy_table_dag creates a bunch of yearly partition tables, including bt, here, and congestion. It failed this year cause it was not scheduled. Next execution date showed by running cli `airflow...
We can now create Markdown-based DAG documentation that appears in the Airflow UI, we should standardize them across all of our dags. https://docs.astronomer.io/learn/custom-airflow-ui-docs-tutorial For Dag level doc, proposing: ```md ###...
Currently the text to centreline function when handling an offset (e.g. 300m south of an intersection), it interpolates the point 300m south of the intersection, snap to the closest centreline...
Transition from pulling probe_path to probe only data for HERE. - [x] Create the same table structure for probe data in `here` schema. - [x] Edit here_api.py to pull for...
Wellington and Blue Jays way detector moved to Gardiner and parliament on July 12th of 2021. As of 2023-05-31, the spadina and bremner got moved to gardiner and dufferin as...
Background: - Miovision pulling process is in airflow - The data validation process we have for miovision right now is `check_miovision` which you can read more [here](https://github.com/CityofToronto/bdit_data-sources/tree/master/volumes/miovision#3-finding-gaps-and-malfunctioning-camera) - Miovision sends...
Through #650 investigation, we noticed the segments on Lakeshore from and to Yonge/Lakeshore (bt_id: 5057, reader_name: LY) were drawn incorrect and goes up to Front street instead of Yonge/Lakeshore. We...
Current the format is yyyymd, it is confusing to know the month and date if one of them are double digited.
## What this pull request accomplishes: - Restart the citywide TTI aggregation task in this new DAG and get rid of all the other tasks that are not relevant anymore...