whd
whd
Background https://github.com/mozilla/gcp-ingestion/pull/732 https://app.circleci.com/settings/project/github/mozilla/gcp-ingestion/ssh?return-to=https%3A%2F%2Fapp.circleci.com%2Fpipelines%2Fgithub%2Fmozilla%2Fgcp-ingestion%3Ffilter%3Dall It looks like (from a :jason screenshot) this deploy key is possibly associated with :wlach, and is separate from the main deploy key. I'm not sure what...
With python-jwcrypto 0.9.1-2. This script should be refactored to produce the same output with non-deprecated functions. It's only used by ops logic to generate keypairs.
[event](https://console.cloud.google.com/monitoring/alerting/incidents/0.m4pb03h7g6io?project=moz-fx-data-ingesti-prod-579d) I presently have no idea what caused this. Ingestion traffic around the time looked normal, and the recent edge deployment / schemas updates completed over 24h before this event....
We're already planning on supporting this for some legacy systems. We might want to also support it for newer systems since it would probably be low effort to support, and...
[Job](https://console.cloud.google.com/dataflow/jobsDetail/locations/us-west1/jobs/2019-10-21_11_50_25-1731386368813309696?project=moz-fx-data-beam-prod-11f7&folder) [Stackdriver](https://app.google.stackdriver.com/services/dataflow/moz-fx-data-beam-prod-11f7;us-west1;structured-decoded_bq-sink_9b31004-1af4aee_3;6560670?project=moz-fx-data-ingesti-prod-579d) This appears to only happen with the live bq sinks, and may or may not be related to https://bugzilla.mozilla.org/show_bug.cgi?id=1590559. The error timing corresponds precisely to when the dataflow...
Stack trace: { "attributeMap": { "args": "", "client_id": "n/a", "content_length": "1143", "document_id": "264ae3b7-5746-42c0-b4c7-55dea61f63f3", "document_namespace": "activity-stream", "document_type": "impression-stats", "document_version": "1", "error_message": "com.google.common.util.concurrent.UncheckedExecutionException: com.google.cloud.bigquery.BigQueryException: Remote host closed connection during handshake", "error_type": "KeyByBigQueryTableDestination",...
This was discussed briefly in our Monday meeting with the outcome being to file an issue to hammer out the details. There are a few classes of special cases where...
For :akkomar to look at in November https://github.com/mozilla/gcp-ingestion/pull/2184#issuecomment-1285882872
From https://github.com/mozilla/bigquery-backfill/pull/20, though there's going to be another TODO to switch to using the pre-built flex templates instead of rebuilding main in order to do backfills. However, it's a fairly...
This change is [](https://reviewable.io/reviews/mozilla-services/data-pipeline/216)