logstash-filter-aggregate icon indicating copy to clipboard operation
logstash-filter-aggregate copied to clipboard

Enable threadsafe = false flag like in multiline filter?

Open alkuzad opened this issue 9 years ago • 2 comments

Hi

I was looking into new features of ELK and I noticed that they've added the option for plugin to specify that it won't work with multiple workers. From https://github.com/logstash-plugins/logstash-filter-multiline/blob/master/lib/logstash/filters/multiline.rb

    # this filter cannot be parallelized because message order
    # cannot be garanteed across threads, line #2 could be processed
    # before line #1
    @threadsafe = false

Is it good to add such feature to aggregate ?

alkuzad avatar Apr 30 '16 13:04 alkuzad

Hi @alkuzad,

I think it could be a good idea. I see two interests :

  • avoid to explicitly set worker filters to 1
  • avoid to make synchronization work in plugin, which could improve plugin performance.

I have to make tests to be sure that this flag implies 1 filter worker.

fbaligand avatar May 01 '16 08:05 fbaligand

Is the @threadsafe = false still under consideration? This improvement would be much appreciated.

painslie avatar Jun 05 '20 03:06 painslie