connect icon indicating copy to clipboard operation
connect copied to clipboard

[Feature Request] Trim whitespaces from columns in CSV scanner/input

Open nerstak opened this issue 9 months ago • 1 comments

Hi!

It would be useful to be able to trim whitespaces from CSV, similar to the trimColumn parameter in File Pulse (Kafka Connector).

Something similar to this:

csv:
  custom_delimiter: ","
  parse_header_row: true
  trim_whitespaces_header_row: true

It would be able to process headers with whitespaces within, such that the following csv:

a ,b ,c 
a1,b1,c1

would be process as {"a":"a1","b":"b1","c":"c1"} instead of {"a ":"a1","b ":"b1","c ":"c1"} (current behavior).

Regards.

nerstak avatar May 28 '24 16:05 nerstak