data-infra
data-infra copied to clipboard
Cal-ITP data infrastructure
**Describe the bug** [Currently our dask images are not working ](https://github.com/cal-itp/data-infra/issues/3363 ), easily confused with just using dask in the jupyter packages. **Expected behavior** If our dask hub is not...
## User story / feature request Determine what may be needed given [Google Cloud transition to Artifact Registry](https://cloud.google.com/blog/products/application-development/understanding-artifact-registry-vs-container-registry). ### Acceptance Criteria We're able to still publish containers?
Terraform was previously implement to manage IAM permissions, but has not been maintained and is no longer functional. We need to allocate resources to reinstate this functionality.
**Describe the bug** Known bug for some time: `dask` image versions don't play nicely with Hub. @vevetron is fixing Hub (#3352) and pinning dependencies to certain versions, and all we...
## User story / feature request When trying to update this [pr](https://github.com/cal-itp/data-infra/pull/3357), failed to update sqlalchemy packages since after 2.0 they made breaking changes. Will probably need to update at...
No log data is visible in Grafana from Loki It appears that all the promtail pods are logging an error about `loki-gateway` not existing. There is no deployment or statefulset...
In #2489, I add a test that a given trip only has one `route_id` on a given service date. At time of writing, there is one failure for Santa Cruz....
Sentry Issues: [CAL-ITP-DATA-INFRA-2458](https://sentry.calitp.org/organizations/sentry/issues/70017/) and [CAL-ITP-DATA-INFRA-13Q0](https://sentry.calitp.org/organizations/sentry/issues/36605) ``` DbtTestFail: test.calitp_warehouse.unique_fct_trip_updates_no_stop_times_key.907b2fcc09 - Got 3844 results, configured to fail if != 0 ``` and ``` DbtTestFail: test.calitp_warehouse.unique_fct_trip_updates_messages_key.8b49751ebd - Got 5 results, configured to fail...
Sentry Issue: [CAL-ITP-DATA-INFRA-24DD](https://sentry.calitp.org/organizations/sentry/issues/70329/?referrer=github_integration) ``` CalledProcessError: Command '['java', '-jar', '/gtfs-realtime-validator.jar', '-gtfs', '/tmp/tmpuqdpd_uu/gtfs.zip', '-gtfsRealtimePath', '/tmp/tmpuqdpd_uu/rt_5cb55aa2d061fe9b41335ec1650d27ef/', '-sort', 'name']' returned non-zero exit status 1. File "gtfs_rt_parser.py", line 634, in parse_and_validate return validate_and_upload( File "gtfs_rt_parser.py",...
## User story / feature request As an Analyst I want to use NTD validation models for 2024 data ### Acceptance Criteria Check if the models bellow are displaying data...