bdit_data-sources
bdit_data-sources copied to clipboard
CityofToronto
Data sources used by the Big Data Innovation Team
## What this pull request accomplishes: - checks for duplicate rows in table `wys.mobile_sign_installations_dupes` after data has been read in by task `read_google_sheets` - if the table is not empty,...
We frequently respond to data requests for volume data at signalized intersections. We should internalize these two transformation: ```sql WITH location_px AS ( -- Select from only arterycodes corresponding to...
## What this pull request accomplishes: - add log cleanup dag to master ## Issue(s) this solves: - There was no issue ## What, in particular, needs to reviewed: -...
WYS Sign `9789` at `486 Midland Avenue` is listed in `wys.wys_stat_signs_speed_limit` as detecting `NB` traffic, but Google street view shows that it is on the west side of Midland Ave...
Three table types: - [ ] ATR - [x] TMC - [ ] Speed Classification Also: - [ ] prepare some kind of lookup spreadsheet for the codes
Like the bluetooth and `miovision` pipelines, the WYS pipeline should be detecting, storing, and (possibly) alerting when large gaps occur in data for each sign (stationary in particular, mobile... for...
New stationary signs don't get updated to Open Data because of missing sign schedule (maybe this should be left joined) https://github.com/CityofToronto/bdit_data-sources/blob/b4cc5dbf4930d5957a87eb2745e16c363412198f/wys/api/sql/open_data/mat-view-stationary-locations.sql#L15-L16 It seems that the issue is that the schedule...
[Most references to `volumes_15min_tmc`](https://github.com/search?q=%22volumes_15min_tmc%22+repo%3ACityofToronto%2Fbdit_data-sources+filename%3AREADME.md&type=Code&ref=advsearch&l=&l=) need to be changed to `volumes_15min_mvt` and then some extra documentation added. Also the giant warning should be deleted.
We have partitioned tables that are monthly/annually. We need to create new ones for the new year and update triggers etc. Procedure in #251, hopefully as much as possible can...
Got a request for data from Mobile WYS sign Ward 3 - S6 because it was apparent in an image. Located the installation in `wys.mobile_sign_installations` with: ```sql SELECT ward_no, location,...
Metadata
Owner
Metadata
Data sources used by the Big Data Innovation Team