logspout icon indicating copy to clipboard operation
logspout copied to clipboard

CPU Usage is bursting when stream of logs

Open Dean-Christian-Armada opened this issue 7 years ago • 1 comments

We have an nginx container that accepts hundreds of request per second and logspout is causing our CPU to burst with the stream of logs it produces. We already applied:

TAIL=0
BACKLOG=true

But still the issue exists. Are there any other solutions?

Take note:

  • We are combining logspout with logstash using this image.. bekt/logspout-logstash:master
  • We are using Docker Swarm Architecture

Dean-Christian-Armada avatar Apr 06 '18 04:04 Dean-Christian-Armada

@Dean-Christian-Armada what transport are you using? tcp or udp? are you also using tls? I have also noticed high cpu usage when sending a ton of logs. logspout may not be the ideal solution when a dealing with an excessive amount of logs. In this case, it may be best to use the dockerd logging drivers to send to a remote host.

gbolo avatar Aug 20 '18 13:08 gbolo