logstash-filter-csv icon indicating copy to clipboard operation
logstash-filter-csv copied to clipboard

Error - Loading csv filter in configuration file :2017-11-07 16:07:32,943 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root"

Open sconrod-tester opened this issue 8 years ago • 0 comments

Error trying to load configuration file to import CSV data via logstash to elasticsearch

  • Version: 5.x most recent GA

  • Operating System: Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.4.0-87-generic x86_64)

  • Config File (if you have sensitive info, please remove it): input { file { path => "/opt/sample-data/bitcoin-data/*.csv" start_position => "beginning" sincedb_path => "/dev/null" } } filter { csv { separator => "," #Date,Open,High,Low,Close,Volume (BTC),Volume (Currency),Weighted Price columns => ["Date","Open","High","Low","Close","Volume (BTC)", "Volume (Currency)" ,"Weighted Price"] user => "logstash_internal" password => "XXXXXXX" } } output { elasticsearch { hosts => "http://localhost:9200" index => "bitcoin-prices" user => "logstash_internal" password => "XXXXXXX" } stdout {} }

  • Sample Data:

  • Steps to Reproduce: bin/logstash -f /etc/logstash/conf.d/bitcoin-data.conf -t

My CSF file is sample data downloaded from here: https://qbox.io/blog/import-csv-elasticsearch-logstash-sincedb

root@ubuntu-16:/usr/share/logstash# bin/logstash -f /etc/logstash/conf.d/bitcoin-data.conf -t 2017-11-07 16:07:32,943 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root" WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console

root@ubuntu-16:/usr/share/logstash# ls -la /etc/logstash/ conf.d/ jvm.options log4j2.properties logstash.yml .logstash.yml.swp startup.options root@ubuntu-16:/usr/share/logstash# ls -la /etc/logstash/

sconrod-tester avatar Nov 08 '17 00:11 sconrod-tester