suzieq icon indicating copy to clipboard operation
suzieq copied to clipboard

Sometimes fails to gather all the necessarry data

Open ton31337 opened this issue 4 years ago • 0 comments

Describe the bug

Lots of such warnings: Task was destroyed but it is pending!

I noticed that this mostly happens with the slow nodes where the latency is 200-300ms.

Additional context

Running command:

  ./bin/sq-poller --devices-file "hosts-$DC.yml" \
    --ignore-known-hosts \
    --run-once gather \
    --exclude-services devconfig

  timeout --signal=TERM 10 ./bin/sq-poller --input-dir ./sqpoller-output

suzieq/suzieq-cfg.yml:

data-directory: ./parquet
temp-directory: /tmp/
poller:
  period: 30
  connect-timeout: 59
  logfile: /tmp/sq-poller.log

I expect to have all the data scraped with the first command run-once and do the computation later, but seems run-once does not gather all the data sometimes.

ton31337 avatar Sep 30 '21 07:09 ton31337