spark-csv icon indicating copy to clipboard operation
spark-csv copied to clipboard

Published 20 hours ago • verified publisher icon databricks

[SPARK-16512] Adding a insertNullOnErrors option.

Open rachelwarren opened this issue 8 years ago • 1 comments

This is the change that allows an option to render errors when parsing such as number format exceptions as nulls. It was in this pull request, https://github.com/databricks/spark-csv/pull/298 but I thought it would be cleaner to create a new one.

rachelwarren avatar Nov 15 '16 03:11 rachelwarren

@rachelwarren as you know this package is in maintenance mode and does not accept patches that modify the API. I suggest you send this patch to Apache Spark, where CSV data source has been in-lined since 2.x.

falaki avatar Nov 15 '16 19:11 falaki