etl icon indicating copy to clipboard operation
etl copied to clipboard

Some tcpinfo rows too large.

Open gfr10598 opened this issue 5 years ago • 1 comments

Inserts are sometimes failing on tcpinfo buffers. Likely due to large number of snapshots for some rows.

Should make two changes:

  1. Limit number of snapshots in a row. Perhaps filter down to 10/second after the first 12 seconds, and 1/second after the first 60 seconds?
  2. Handle insert errors by submitting rows individually.

gfr10598 avatar Jun 13 '19 11:06 gfr10598

#2 is done. The buffer is now split in half and retried. Only single row failures are not retried.

gfr10598 avatar Jan 21 '20 14:01 gfr10598