data-infra icon indicating copy to clipboard operation
data-infra copied to clipboard

Cal-ITP data infrastructure

Results 359 data-infra issues
Sort by recently updated
recently updated
newest added

## User story I'm beginning to work on building out [5 metrics](https://docs.google.com/document/d/1YWufBcHGkCO8iYuP57snT7oDiNeX8R-WM2H1bNHVdRo/edit#heading=h.s6rvm1tuuni) to assess the quality of GTFS-rt predictions - this work should go on for the duration of August...

## User story / feature request As a transit data quality analyst, I would like to have MTC 511's list of operators available to query in metabase, So that I...

In several of our agencies' Littlepay data, either all or ~half of micropayments have a `charge_type` value of `pending_charge_fare` which is not documented in LP's data documentation. As a data...

project-payments
external-question

This account runs our CI across a number of packages. Let's double check that it only has permissions it needs.

handoff

**As far as I know, no one is using fare systems data in the warehouse at time of writing (November 2023). This ticket will only become relevant if that changes.**...

As a Cal-ITP GTFS data user, I want rows to be unique at the expected level so that they don't cause unexpected fanout in joins. Specifically, rows in `dim_calendar_dates` with...

Sentry Issue: [CAL-ITP-DATA-INFRA-145X](https://sentry.calitp.org/organizations/sentry/issues/37083/?referrer=github_integration) ``` DbtTestFail: test.calitp_warehouse.unique_int_gtfs_quality__rt_validation_outcomes_key.6c4eae7fe1 - Got 1 result, configured to fail if != 0 ``` This is failing because there are hours with null extracts; I think the...

data-pipeline-ingestion-and-modeling

As a Cal-ITP data user, I don't want duplicate data in the warehouse so that I can be sure that my joins won't cause fanout. Specifically, we don't want duplicate...

As a Cal-ITP data consumer, I would like Composer to be upgraded to ensure continuity of Airflow workflows and avoid potential failures due to using an unsupported Composer version. Context:...

**Describe the bug** Before moving to a local development setup, a recent new user in the Cal-ITP ecosystem (a contractor, not a Caltrans staffer) attempted to get set up to...