bdit_data-sources

bdit_data-sources copied to clipboard

The DAG run of Aug 22, 2022 stopped due to an unhandled exception: `json.decoder.JSONDecodeError`. Here is the full stack: ``` [2022-08-25 12:12:05,095] {taskinstance.py:1150} ERROR - Expecting value: line 1 column...

tahaislam

New HERE documentation!

1

## What this pull request accomplishes: - Organizes, updates and cross-references documentation for our HERE data - ## Issue(s) this solves: - #481 ## What, in particular, needs to reviewed:...

scann0n

Missing Miovision Dates

3

- [ ] January 27, 2022 - [x] June 29, 2022 at least for the RapidTO locations

radumas

Performance improvements for WYS and Miovision pipelines: reduce dead tuples

6

So this might be why miovision 15min aggregation is taking a real long time. ```sql select * from pg_stat_all_tables ORDER BY n_dead_tup DESC LIMIT 10 ``` In the top 4...

radumas

Document centreline & centreline_intersection pitfalls and create useful transformations

8

The centreline contains more than just streets. We should document pitfalls to avoid when querying it and also create useful transformations (in particular of the intersections table).

radumas

Reform process for creating unique IDs for Open Data

2

For each `api_id` in the `wys.locations` table, the record with the earliest `start_date`, that `start_date` should be the first date we have data in the `wys.speed_counts_agg_5kph` table. This cascades into...

radumas

There are around 541 tables with srid=0 in the database. Here we can discuss and document problems that come up during the update. In order to update tables' srid, we...

raha1986

Update travel time documentation

3

Our HERE documentation is a wee bit out of date / not geared for noobs. Also there should be documentation for Bluetooth...

scann0n

## What this pull request accomplishes: - Makes a map of live Bluetooth routes and detectors - ## Issue(s) this solves: - # ## What, in particular, needs to reviewed:...

radumas

Get rid of _value_ attribute for outcome_arr and routepoint_arr

1

## What this pull request accomplishes: - Got rid of _value_ attribute in json for outcome and routepoint column in `bluetooth.all_analyses` - e.g. ``` SELECT all_analyses.analysis_id, (all_analyses.route_points -> 0) ->>...

chmnata