data-infra icon indicating copy to clipboard operation
data-infra copied to clipboard

Cal-ITP data infrastructure

Results 177 data-infra issues
Sort by recently updated
recently updated
newest added

**Describe the bug** [Currently our dask images are not working ](https://github.com/cal-itp/data-infra/issues/3363 ), easily confused with just using dask in the jupyter packages. **Expected behavior** If our dask hub is not...

infrastructure

## User story / feature request Determine what may be needed given [Google Cloud transition to Artifact Registry](https://cloud.google.com/blog/products/application-development/understanding-artifact-registry-vs-container-registry). ### Acceptance Criteria We're able to still publish containers?

Terraform was previously implement to manage IAM permissions, but has not been maintained and is no longer functional. We need to allocate resources to reinstate this functionality.

infrastructure

**Describe the bug** Known bug for some time: `dask` image versions don't play nicely with Hub. @vevetron is fixing Hub (#3352) and pinning dependencies to certain versions, and all we...

## User story / feature request When trying to update this [pr](https://github.com/cal-itp/data-infra/pull/3357), failed to update sqlalchemy packages since after 2.0 they made breaking changes. Will probably need to update at...

No log data is visible in Grafana from Loki It appears that all the promtail pods are logging an error about `loki-gateway` not existing. There is no deployment or statefulset...

In #2489, I add a test that a given trip only has one `route_id` on a given service date. At time of writing, there is one failure for Santa Cruz....

data-pipeline-ingestion-and-modeling

Sentry Issues: [CAL-ITP-DATA-INFRA-2458](https://sentry.calitp.org/organizations/sentry/issues/70017/) and [CAL-ITP-DATA-INFRA-13Q0](https://sentry.calitp.org/organizations/sentry/issues/36605) ``` DbtTestFail: test.calitp_warehouse.unique_fct_trip_updates_no_stop_times_key.907b2fcc09 - Got 3844 results, configured to fail if != 0 ``` and ``` DbtTestFail: test.calitp_warehouse.unique_fct_trip_updates_messages_key.8b49751ebd - Got 5 results, configured to fail...

data-pipeline-ingestion-and-modeling

Sentry Issue: [CAL-ITP-DATA-INFRA-24DD](https://sentry.calitp.org/organizations/sentry/issues/70329/?referrer=github_integration) ``` CalledProcessError: Command '['java', '-jar', '/gtfs-realtime-validator.jar', '-gtfs', '/tmp/tmpuqdpd_uu/gtfs.zip', '-gtfsRealtimePath', '/tmp/tmpuqdpd_uu/rt_5cb55aa2d061fe9b41335ec1650d27ef/', '-sort', 'name']' returned non-zero exit status 1. File "gtfs_rt_parser.py", line 634, in parse_and_validate return validate_and_upload( File "gtfs_rt_parser.py",...

## User story / feature request As an Analyst I want to use NTD validation models for 2024 data ### Acceptance Criteria Check if the models bellow are displaying data...

product: ntd reporting