bdit_data-sources
bdit_data-sources copied to clipboard
Data sources used by the Big Data Innovation Team
From #187, `link_dir = '756455452T'` seems to have an unusually high cost which leads trips to route off the highway instead. Investigate cost network for 2016-10-20 9:30 am and 20:25:52...
As part of the validation, the EC2 script could compare most recent day of observations with the `cod` table to identify whether there are CODs that we don't know about...
The checking query status piece seems to occasionally return poorly formed json, the function should check the status of the request that before trying to parse the json. ```python 2019-04-09...
~Make this a sub-program under `data_utils`~ - [ ] Create a json configuration matching URL and database table - [ ] Pull data and unzip data if necessary - [...
Use `datetime.now()` to update https://github.com/CityofToronto/bdit_data-sources/blob/master/volumes/scoot/python/load_cyclelevel.py#L27
@aharpalaniTO to add readme for [parking](https://github.com/CityofToronto/bdit_data-sources/) subfolder