logstash-filter-csv icon indicating copy to clipboard operation
logstash-filter-csv copied to clipboard

Published 20 hours ago • verified publisher icon logstash-plugins

limit workers to 1 when autodetect_column_names is enabled

Open robin13 opened this issue 5 years ago • 1 comments

As fixing https://github.com/logstash-plugins/logstash-filter-csv/issues/65 is a big issue requiring fundamental work on logstash to synchronize between threads, would it be possible for the interim to

  1. Document that when autodetect_column_names is true pipeline.workers must be set to 1
  2. Have a startup check such that if autodetect_column_names is true and pipeline.workers is >1 then startup will fail (similar to the way the aggregate filter does).

robin13 avatar Mar 13 '19 14:03 robin13

the new csv codec should be more appropriate for this, when paired with the file input a new codec instance will be used per file.

colinsurprenant avatar Feb 21 '20 16:02 colinsurprenant