bdit_data-sources
bdit_data-sources copied to clipboard
CityofToronto
Data sources used by the Big Data Innovation Team
## What this pull request accomplishes: - formats code blocks in docs for legibility / consistency ## Issue(s) this solves: - code blocks were hard to read ## What, in...
## What this pull request accomplishes: - Updated GCC puller scripts - Updated the DAG that periodically pulls layers using Airflow - Have layers that will be used in VFH...
we should have a `weather` folder in this repo and a corresponding `weather` schema to hold our weather tables
## What this pull request accomplishes: - fix null values issues ## Issue(s) this solves: - #505 ## What, in particular, needs to reviewed: - New sql - Some changes...
It will run on the On-Prem Dev server and send data to both the on-prem database and our RDS. The state of the code is currently in https://github.com/CityofToronto/bdit_data-sources/tree/gcc_view/gis/gccview Layers that...
## What this pull request accomplishes: - It handles the exception `json.decoder.JSONDecodeError` in `wys_api.py` by logging the returned error message and passing the exception back to the calling function in...
> [2022-10-05 15:39:04,339] {wys_api.py:363} CRITICAL - Error aggregating data to 1-hour bins > [2022-10-05 15:39:04,339] {wys_api.py:364} CRITICAL - null value in column "volume" violates not-null constraint > DETAIL: Failing row...
Three issues here: 1. There are a number of intersections which need to be backfilled with data (outlined here: #416) 2. There are intersections that are currently down. 3. There...
Not only does it not alert us to these, but it does also fill in 0s for them instead of `NULL`
Metadata
Owner
Metadata
Data sources used by the Big Data Innovation Team