unexpected error error_class=TypeError error="no implicit conversion of Symbol into Integer"

[sankujain]

Hello Toyokazu,

Hope you are doing well

Recently we stuck with this issue, sometimes we are found that size of the log file is 0 Bytes whereas the size of log.meta 64K.

Due to this, we are getting auto restarted td-agent

2018-04-19 17:57:43 +0530 [info]: #0 starting fluentd worker pid=17987 ppid=1814 worker=0 2018-04-19 17:57:43 +0530 [error]: #0 unexpected error error_class=TypeError error="no implicit conversion of Symbol into Integer" 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:219:in []' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:219:in restore_metadata' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:322:in load_existing_staged_chunk' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:51:in initialize' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:144:in new' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:144:in block in resume' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:133:in glob' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:133:in resume' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:171:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:120:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:415:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/event_loop.rb:76:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/timer.rb:52:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/formatter.rb:96:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-mqtt-io-0.4.0/lib/fluent/plugin/out_mqtt.rb:70:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:165:in block in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:144:in block (2 levels) in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/agent.rb:119:in block (2 levels) in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/agent.rb:118:in each' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/agent.rb:118:in block in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/agent.rb:111:in each' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/agent.rb:111:in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:143:in block in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:140:in each' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:140:in lifecycle' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/root_agent.rb:164:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/engine.rb:274:in start' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/engine.rb:219:in run' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/supervisor.rb:774:in run_engine' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/supervisor.rb:523:in block in run_worker' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/supervisor.rb:699:in main_process' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/supervisor.rb:518:in run_worker' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb:316:in <top (required)>' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:55:in require' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:55:in require' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/bin/fluentd:8:in <top (required)>' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/bin/fluentd:22:in load' 2018-04-19 17:57:43 +0530 [error]: #0 /opt/td-agent/embedded/bin/fluentd:22:in <top (required)>' 2018-04-19 17:57:43 +0530 [error]: #0 /usr/sbin/td-agent:7:in load' 2018-04-19 17:57:43 +0530 [error]: #0 /usr/sbin/td-agent:7:in <main>' 2018-04-19 17:57:43 +0530 [error]: #0 unexpected error error_class=TypeError error="no implicit conversion of Symbol into Integer" 2018-04-19 17:57:43 +0530 [error]: #0 suppressed same stacktrace 2018-04-19 17:57:43 +0530 [info]: Worker 0 finished unexpectedly with status 1 2018-04-19 17:57:43 +05

During this, we are losing our data which is coming over mqtt.

Please help us solve this issue.

Thanks in advance

[toyokazu]

Sorry for my too late reply. If you are still trying to solve the problem, could you provide your configuration and sample data to reproduce the issue?