cloudquery icon indicating copy to clipboard operation
cloudquery copied to clipboard

Logs: Add startup logs to help debug throttling stuff

Open shimonp21 opened this issue 3 years ago • 2 comments
trafficstars

Is your feature request related to a problem? Please describe.

We encounter a lot of throttling errors. It'd be great if on startup of cloudquery we could log a bunch of related info to help debug it:

  • memory on the machine
  • ullimits (soft + hard)
  • kernel "open file" limits

shimonp21 avatar Jun 22 '22 12:06 shimonp21

also version

shimonp21 avatar Jun 22 '22 13:06 shimonp21

Add them to cmd/root.go:logInvocationParams or make another fn and call it from rootCmd.PersistentPreRunE just like logInvocationParams is called.

disq avatar Jun 23 '22 14:06 disq

Im closing this for now and we can reopen once we will get those issues again given a lot was changed including more consistent logging and concurrency.

yevgenypats avatar Oct 08 '22 18:10 yevgenypats