logstash-filter-aggregate
logstash-filter-aggregate copied to clipboard
Enable threadsafe = false flag like in multiline filter?
Hi
I was looking into new features of ELK and I noticed that they've added the option for plugin to specify that it won't work with multiple workers. From https://github.com/logstash-plugins/logstash-filter-multiline/blob/master/lib/logstash/filters/multiline.rb
# this filter cannot be parallelized because message order
# cannot be garanteed across threads, line #2 could be processed
# before line #1
@threadsafe = false
Is it good to add such feature to aggregate ?
Hi @alkuzad,
I think it could be a good idea. I see two interests :
- avoid to explicitly set worker filters to 1
- avoid to make synchronization work in plugin, which could improve plugin performance.
I have to make tests to be sure that this flag implies 1 filter worker.
Is the @threadsafe = false still under consideration? This improvement would be much appreciated.