fleet icon indicating copy to clipboard operation
fleet copied to clipboard

too many weird errs in the log

Open eastbook opened this issue 2 years ago • 1 comments

Fleet version: _(head to the "My account" page in the Fleet UI or run fleetctl --version)_4.20.0

Sep 13 21:47:27 n121-008-225 fleet[2608221]: {"component":"http","err":"authentication error: find host: context canceled","level":"info","path":"/api/v1/osquery/log","ts":"2022-09-13T21:29:58.123915532Z"} Sep 13 21:47:27 n121-008-225 fleet[2608221]: {"component":"http","err":"retrieve label queries: selecting label queries for host: context canceled","ip_addr":"10.121.83.82","level":"error","method":"POST","took":"15.948954683s","ts":"2022-09-13T21:29:58.1239034Z","uri":"/ Sep 13 21:47:27 n121-008-225 fleet[2608221]: {"component":"http","err":"retrieve policy queries: selecting policies for host: context canceled","ip_addr":"10.121.108.35","level":"error","method":"POST","took":"15.987679842s","ts":"2022-09-13T21:29:58.120432363Z","uri":"/a Sep 13 21:47:26 n121-008-225 fleet[2608221]: {"component":"http","err":"error in query ingestion || error in query ingestion || error in query ingestion || error in query ingestion || error in query ingestion || error in query ingestion || getting app config: selecting ap

We got a lot of these lines of repeat errs from the log.

I am quite confused about these errs could someone help to explain what does it mean?

eastbook avatar Sep 13 '22 23:09 eastbook

Hi @eastbook.

Most of the times, these context canceled errors are due to:

  1. Slow MySQL database given the number of hosts (host requests time out before the database operation completes).
  2. A timeout (of 15s, see took values in the log lines) configured somewhere in between the hosts and Fleet, maybe a proxy?

lucasmrod avatar Sep 14 '22 15:09 lucasmrod

@eastbook Did either of the two comments Lucas made help with narrowing down the cause of your issues? If not I would recommend joining the osquery slack channel. This doesn't appear to be a bug at this time.

xpkoala avatar Sep 30 '22 17:09 xpkoala