fluentd icon indicating copy to clipboard operation
fluentd copied to clipboard

v1.17.1 sometimes kills in_monitor_http_server_helper thread

Open johnmanjiro13 opened this issue 6 months ago • 4 comments

Describe the bug

We use a docker image (v1.17-debian) of fluentd with fluent-logger-golang. Since the release of 1.17.1, it now kills threads and outputs WARN logs as shown below.

To Reproduce

I haven't found a way to reproduce this yet. Here is our Dockerfile.

FROM fluent/fluentd:v1.17-debian

USER root
RUN apt-get update && \
    apt-get -y install wget && \
    apt-get clean && rm -rf /var/lib/apt/lists/*

Expected behavior

fluentd doesn't output WARN logs

Your Environment

- Fluentd version: 1.17.1
- Package version:
- Operating system: Linux
- Kernel version:

Your Configuration

<system>
  log_level info
  <log>
    format json
  </log>
</system>

<label @FLUENT_LOG>
  <match fluent.*>
    @type null
  </match>
</label>

<source>
  @type monitor_agent
  bind 0.0.0.0
  port 24220
</source>

<source>
  @type forward
  @id forward_input
</source>

<source>
  @type http
  port 9880
  bind 0.0.0.0
</source>

<match fluentd.pod.**>
  @type null
</match>


<match log.**>
  @type forward
  expire_dns_cache 0
  dns_round_robin true
  heartbeat_type transport
  require_ack_response true

  <buffer>
    @type file
    path /mnt/fluentd/forward
    flush_at_shutdown true
    flush_interval 0.1
  </buffer>

  <server>
    name destination
    host destination
  </server>
</match>

Your Error Log

killing existing thread thread=#<Thread:0x00007f66153e9b80@in_monitor_http_server_helper /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/plugin_helper/thread.rb:70 sleep>

thread doesn't exit correctly (killed or other reason) plugin=Fluent::Plugin::MonitorAgentInput title=:in_monitor_http_server_helper thread=#<Thread:0x00007f66153e9b80@in_monitor_http_server_helper /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/plugin_helper/thread.rb:70 aborting> error=nil

Additional context

No response

johnmanjiro13 avatar Aug 20 '24 08:08 johnmanjiro13