logstash-filter-csv
logstash-filter-csv copied to clipboard
Logstash CSV Filter CSV::MalformedCSVError: Unclosed quoted field on line 1
When there is extra space at the end of header lines, CSV filter is throwing :exception=>#<CSV::MalformedCSVError: Unclosed quoted field on line 1.>
13:18:22.297 [[main]>worker3] WARN logstash.filters.csv - Error parsing csv {:field=>"message", :source=>"\"EVENT_TYPE\",\"TIMESTAMP\",\"REQUEST_ID\",\"ORGANIZATION_ID\" ", :exception=>#<CSV::MalformedCSVError: Unclosed quoted field on line 1.>} { "path" => "/root/logs/resp.csv", "@timestamp" => 2018-04-02T17:18:22.275Z, "@metadata" => { "path" => "/root/logs/resp.csv", "host" => "localhost.localdomain" }, "@version" => "1", "host" => "localhost.localdomain", "message" => "\"EVENT_TYPE\",\"TIMESTAMP\",\"REQUEST_ID\",\"ORGANIZATION_ID\" ", "type" => "log", "tags" => [ [0] "_csvparsefailure" ] }
For all general issues, please provide the following details for fast resolution:
-
Version: Logstash 5.6.5, logstash-filter-csv (3.0.8)
-
Operating System: CentOS 7
-
Config File (if you have sensitive info, please remove it):
-
Sample Data: "EVENT_TYPE","TIMESTAMP","REQUEST_ID","ORGANIZATION_ID" "Login","20171121084959.473","4EZCfzVyNz7hAe-qbwsdY-","00D0m000000CpL6"
-
Steps to Reproduce: