s3select icon indicating copy to clipboard operation
s3select copied to clipboard

Published 20 hours ago • verified publisher icon vast-engineering

Improve quoting options

Open goodside opened this issue 5 years ago • 0 comments

This PR improves adds improved quoting options for CSVs:

  • -q or --quote_character for the API QuoteCharacter field
  • -Q or --quote_escape_character for the API QuoteEscapeCharacter field
  • -A or --allow_quoted_record_delimiter for the API AllowQuotedRecordDelimiter field (boolean)

Note there is a minor change in behavior between this PR and commit 728788a, which itself introduces a change to quoting defaults by setting QuoteCharacter to the empty string (with no option for configuration).

I'd expect when no options are given behavior should be consistent with the defaults of boto3 and the underlying S3 Select API. This PR accomplishes that, while allowing other options to be used with -q/-Q/-A.

goodside avatar Jun 17 '19 06:06 goodside