etl icon indicating copy to clipboard operation
etl copied to clipboard

tcpinfo: consider minimizing snapshot thinning

Open stephen-soltesz opened this issue 2 years ago • 1 comments

Originally, tcpinfo snapshots were thinned 10:1, leaving what could be up to 10ms resolution to 100ms for NDT measurements. For more detailed analysis this higher resolution may be preferable. However, the rows will be larger, BQ storage more expensive and queries more costly. So, we want to strike a balance by revising the simple 10:1 implementation with one that meets needs for analysis.

See also:

  • https://github.com/m-lab/etl/issues/961
  • https://github.com/m-lab/etl/issues/727
  • https://github.com/m-lab/etl/issues/685

stephen-soltesz avatar Mar 18 '22 20:03 stephen-soltesz

Also related to:

  • https://github.com/m-lab/etl/issues/1106

stephen-soltesz avatar Oct 11 '22 16:10 stephen-soltesz