data-infra
data-infra copied to clipboard
Cal-ITP data infrastructure
## User story I'm beginning to work on building out [5 metrics](https://docs.google.com/document/d/1YWufBcHGkCO8iYuP57snT7oDiNeX8R-WM2H1bNHVdRo/edit#heading=h.s6rvm1tuuni) to assess the quality of GTFS-rt predictions - this work should go on for the duration of August...
## User story / feature request As a transit data quality analyst, I would like to have MTC 511's list of operators available to query in metabase, So that I...
In several of our agencies' Littlepay data, either all or ~half of micropayments have a `charge_type` value of `pending_charge_fare` which is not documented in LP's data documentation. As a data...
This account runs our CI across a number of packages. Let's double check that it only has permissions it needs.
**As far as I know, no one is using fare systems data in the warehouse at time of writing (November 2023). This ticket will only become relevant if that changes.**...
As a Cal-ITP GTFS data user, I want rows to be unique at the expected level so that they don't cause unexpected fanout in joins. Specifically, rows in `dim_calendar_dates` with...
Sentry Issue: [CAL-ITP-DATA-INFRA-145X](https://sentry.calitp.org/organizations/sentry/issues/37083/?referrer=github_integration) ``` DbtTestFail: test.calitp_warehouse.unique_int_gtfs_quality__rt_validation_outcomes_key.6c4eae7fe1 - Got 1 result, configured to fail if != 0 ``` This is failing because there are hours with null extracts; I think the...
As a Cal-ITP data user, I don't want duplicate data in the warehouse so that I can be sure that my joins won't cause fanout. Specifically, we don't want duplicate...
As a Cal-ITP data consumer, I would like Composer to be upgraded to ensure continuity of Airflow workflows and avoid potential failures due to using an unsupported Composer version. Context:...
**Describe the bug** Before moving to a local development setup, a recent new user in the Cal-ITP ecosystem (a contractor, not a Caltrans staffer) attempted to get set up to...