Natalie

@tankedman Archived documentation is out of date, please run the aggregation part with the following functions in order: ``` miovision_api.find_gaps miovision_api.aggregate_15_min_mvt miovision_api.aggregate_15_min miovision_api.report_dates ```

Documenting my confusion here so we can discuss on Monday: Jedwin's nohup.out shows that `miovision_api.aggregate_15_min_mvt` is trying insert a duplicated value ``` ERROR: duplicate key value violates unique constraint "volumes_15min_mvt_intersection_uid_datetime_bin_classificat_key"...

As discussed with @radumas, we can add a filter for the intersection_uid we are aggregating for in the function's sql and run that first . @tankedman wanna try creating the...

Backfilling for January 17, 2022 returned the below error: ``` [2022-08-11 09:44:03,121] {bash_operator.py:157} INFO - 11 Aug 2022 09:44:03 INFO Bayview Avenue and River Street 2022-01-27 06:00:00 [2022-08-11 09:44:03,679] {bash_operator.py:157}...

Backfilled for Jan 27 for all other intersection except uid 65, tried re-pulling for 65 after miovision rolling back the config and still got the same error

table with `analysis_id`, `street`, `direction`, `from_street`, `to_street`, `from_geom`, `to_geom`, `from_id`, `to_id` in `natalie.new_detectors` temporarily view with int_id and blutooth_id in `natalie.bluetooth_nodes`

Route new bluetooth routes with `gis.centreline_routing_undirected` ``` with lookup as ( select analysis_id, from_id, origin.int_id as source, to_id, dest.int_id as target from new_detectors inner join bluetooth_nodes origin on from_id =...

Draw new routes with the below sql, currently in `natalie.new_bluetooth_segments` ``` with lookup as ( select analysis_id, from_id, origin.int_id as source, to_id, dest.int_id as target from new_detectors inner join bluetooth_nodes...

Validating with direction, everything is fine. ``` select * from new_bluetooth_segments where gis.twochar_direction(gis.direction_from_line(geom)) != direction ``` Validating by 👀 and everything looks like its been routed from intersection to intersection...

Need to redraw `analysis_id in (1495610,1495638,195370,1496238,1496264,1496289)` by updating `natalie.new_detectors_updated` with the correct int_id Changed int_id to the correct intersection_id but still routed using Gardiner instead of Lakeshore. Going to filter...