Stephen Soltesz
Stephen Soltesz
Recently, several changes have altered the relationship between the etl and ndt-server repos. * altered ndt7 archive schema such that etl/cmd/update-schema fails or ndt tables. * disable ndt5 support in...
We expect those numbers to be very close ~95+% -- but when it drops too low there may be another problem with data collection or parsing or inserting to BQ...
TCPParser unit tests appear to depend on annotator. ``` 2019/06/19 17:56:45 task.go:138: Processed 364 files, 0 nil data, 362 rows committed, 0 failed, from testdata/20190516T013026.744845Z-tcpinfo-mlab4-arn02-ndt.tgz into ndt_test --- PASS: TestTCPParser...
During the Gardener deployments, we have discovered that traceroute write performance prevents many tasks from completing, which prevents Gardener from making progress. [The reason](https://github.com/m-lab/dev-tracker/issues/126) is the combination of 1hr response...
``` read MACHINE SERVER_URL
The ndt7 archival format does not include the average rate observed by the client or server. So, the data pipeline uses the last observed tcpinfo snapshot to calculate the average...
Due to inadequate pre-production verification, the deployment of https://github.com/m-lab/etl/pull/1118 resulted in service disruption for M-Lab BQ users. The ideal approach is to have the bigquery-exporter [bq_daily_discuss.sql](https://github.com/m-lab/prometheus-support/blob/main/config/federation/bigquery/bq_daily_discuss.sql) query reference the unified...
From the analysis of scamper1 data, we suspect that a significant portion (as high as 70% of some datatypes) of all archive data is either operation or ambient traffic -...
[2023-04 Milestone: Wehe Localization](https://docs.google.com/document/d/1YO8tN5OAYIYs0Yacqspo7rZuWt-vuyQWq_Bi8MFK0YY/edit#)
Bigquery job stats include query costs. The bigquery-exporter should report the costs of queries run along with other metrics.