datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Support record delimiter ("terminator" in Arrow terms) for CSV reading

Open Blizzara opened this issue 6 months ago • 1 comments

Is your feature request related to a problem or challenge?

Current CSV reading / writing already supports a bunch of options, like field delimiter and quote chars. However, record delimiter (usually something like "\n" or "\r\n") is not supported in DF. It (as "terminator") is supported in arrow-csv though, should be easy plumbing to add to DF as well.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Blizzara avatar Aug 28 '24 13:08 Blizzara