fluent-plugin-webhdfs icon indicating copy to clipboard operation
fluent-plugin-webhdfs copied to clipboard

Published 20 hours ago • verified publisher icon fluent

use chunk_id in path

Open bobykus31 opened this issue 5 years ago • 3 comments

According to your documentation it is allowed to use

path "/log/access/%Y%m%d/#{Socket.gethostname}.${chunk_id}.log"

In my case

path "/raw/syslog/logdate=%Y%m%d/loghour=%H/#{Socket.gethostname}.${chunk_id}.journald.log"

failed to communicate hdfs cluster, path: /raw/syslog/logdate=20190625/loghour=07/fluentd3.2019-06-25 08:11:10 +0000 [warn]: #10 ${chunk_id} is not allowed in this plugin. Pass Chunk instead of metadata in extract_placeholders's 2nd argument.journald.log.gz

It is acceptable to use worker_id as https://github.com/fluent/fluentd/issues/1473 in my case only.

bobykus31 avatar Jun 25 '19 08:06 bobykus31

This has been already fixed in #70. @repeatedly Could you release new version of this plugin?

okkez avatar Jul 09 '19 05:07 okkez

Sorrry. I forgot to release new version. Just released v1.2.4.

repeatedly avatar Jul 09 '19 06:07 repeatedly

Thank you for the quick response!

okkez avatar Jul 09 '19 07:07 okkez