logstash-filter-csv icon indicating copy to clipboard operation
logstash-filter-csv copied to clipboard

Logstash CSV Filter CSV::MalformedCSVError: Unclosed quoted field on line 1

Open sasubillis opened this issue 7 years ago • 0 comments

When there is extra space at the end of header lines, CSV filter is throwing :exception=>#<CSV::MalformedCSVError: Unclosed quoted field on line 1.>

13:18:22.297 [[main]>worker3] WARN logstash.filters.csv - Error parsing csv {:field=>"message", :source=>"\"EVENT_TYPE\",\"TIMESTAMP\",\"REQUEST_ID\",\"ORGANIZATION_ID\" ", :exception=>#<CSV::MalformedCSVError: Unclosed quoted field on line 1.>} { "path" => "/root/logs/resp.csv", "@timestamp" => 2018-04-02T17:18:22.275Z, "@metadata" => { "path" => "/root/logs/resp.csv", "host" => "localhost.localdomain" }, "@version" => "1", "host" => "localhost.localdomain", "message" => "\"EVENT_TYPE\",\"TIMESTAMP\",\"REQUEST_ID\",\"ORGANIZATION_ID\" ", "type" => "log", "tags" => [ [0] "_csvparsefailure" ] }

For all general issues, please provide the following details for fast resolution:

  • Version: Logstash 5.6.5, logstash-filter-csv (3.0.8)

  • Operating System: CentOS 7

  • Config File (if you have sensitive info, please remove it):

  • Sample Data: "EVENT_TYPE","TIMESTAMP","REQUEST_ID","ORGANIZATION_ID" "Login","20171121084959.473","4EZCfzVyNz7hAe-qbwsdY-","00D0m000000CpL6"

  • Steps to Reproduce:

sasubillis avatar Apr 02 '18 18:04 sasubillis