amazon-kinesis-agent icon indicating copy to clipboard operation
amazon-kinesis-agent copied to clipboard

Published 20 hours ago • verified publisher icon awslabs

CSVTOJSON embeds extra quotation marks

Open jagilbert27 opened this issue 5 years ago • 0 comments

The agent successfully reads my csv, transforms it to json and places it in a firehose. The problem is that it's embedding extra quotes around field values.

For example, my input record: "","+14048721234","9169701234","some text ","+14048721234"... Is encoded as: {"Account":"\"\"","Source":"\"+14048721234\"","Destination":"\"9722461234\"","DestinationContext":"\"some text\"","CallerId":"\"+14048721234\""...

In a sense it is correct because the quotes are in the source data. OTOH, the extra quotes are superfluous and require extra decoding on the receiving end.

jagilbert27 avatar Feb 17 '20 18:02 jagilbert27