logstash-filter-csv
logstash-filter-csv copied to clipboard
Error - Loading csv filter in configuration file :2017-11-07 16:07:32,943 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root"
Error trying to load configuration file to import CSV data via logstash to elasticsearch
-
Version: 5.x most recent GA
-
Operating System: Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.4.0-87-generic x86_64)
-
Config File (if you have sensitive info, please remove it): input { file { path => "/opt/sample-data/bitcoin-data/*.csv" start_position => "beginning" sincedb_path => "/dev/null" } } filter { csv { separator => "," #Date,Open,High,Low,Close,Volume (BTC),Volume (Currency),Weighted Price columns => ["Date","Open","High","Low","Close","Volume (BTC)", "Volume (Currency)" ,"Weighted Price"] user => "logstash_internal" password => "XXXXXXX" } } output { elasticsearch { hosts => "http://localhost:9200" index => "bitcoin-prices" user => "logstash_internal" password => "XXXXXXX" } stdout {} }
-
Sample Data:
-
Steps to Reproduce: bin/logstash -f /etc/logstash/conf.d/bitcoin-data.conf -t
My CSF file is sample data downloaded from here: https://qbox.io/blog/import-csv-elasticsearch-logstash-sincedb
root@ubuntu-16:/usr/share/logstash# bin/logstash -f /etc/logstash/conf.d/bitcoin-data.conf -t 2017-11-07 16:07:32,943 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root" WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console
root@ubuntu-16:/usr/share/logstash# ls -la /etc/logstash/ conf.d/ jvm.options log4j2.properties logstash.yml .logstash.yml.swp startup.options root@ubuntu-16:/usr/share/logstash# ls -la /etc/logstash/