fluentd icon indicating copy to clipboard operation
fluentd copied to clipboard

disable fluentd time related file-splitting functionality

Open lixiaochun opened this issue 3 years ago • 4 comments

Check CONTRIBUTING guideline first and here is the list to help us investigate the problem.

Is your feature request related to a problem? Please describe.

I use out file plugin in my case, the out file is splited daily by default. but I would like to disable fluentd time related file-splitting functionality so that I can use logrotate to fully split file based on time and size.

I don't know how to disable fluentd time related file-splitting functionality.

hope it can be supported.

I'm looking forward to your feedback:)

lixiaochun avatar Apr 06 '21 08:04 lixiaochun

I got some point from here, but still have no idea about how to disable time slicing for out file plugin. I really need your help:) https://serverfault.com/questions/620770/configuring-logrotate-for-fluentd-files-necessary

lixiaochun avatar Apr 06 '21 12:04 lixiaochun

It seems that no way to disable slicing at the moment. but how about specifying longer-term in timekey in <buffer> section? (it may be a dirty workaround)

BTW, why do you want to disable? What is missing feature for fluentd?

kenhys avatar Apr 07 '21 05:04 kenhys

It seems that no way to disable slicing at the moment. but how about specifying longer-term in timekey in <buffer> section? (it may be a dirty workaround)

BTW, why do you want to disable? What is missing feature for fluentd?

@ hi kenhys, I would like to slice output file based on size and time. ​ because in my case the the output file generated by file plugin is still too big even specifying daily longer-term in timekey as I know, only time slicing is supported by fluentd file plugin, size slicing is not supported this is why I want to disable time slicing for fluentd file plugin, and the output file is fully sliced using logrotate instead of fluentd file plugin to implement size and time based slicing...

lixiaochun avatar Apr 08 '21 01:04 lixiaochun

is there alternative way to solve it?

lixiaochun avatar Apr 09 '21 11:04 lixiaochun