spark-snowflake icon indicating copy to clipboard operation
spark-snowflake copied to clipboard

Published 20 hours ago • verified publisher icon snowflakedb

Support spark.sql.datetime.java8API.enabled

Open tom-s-powell opened this issue 1 year ago • 4 comments

Support Spark's spark.sql.datetime.java8API.enabled property when true. This expects dates and timestamp to be java.time.LocalDate and java.time.Instant respectively rather than the java.sql equivalents.

tom-s-powell avatar Aug 25 '23 16:08 tom-s-powell

Any update on when we may be able to get this in?

tom-s-powell avatar Sep 29 '23 10:09 tom-s-powell

I've simplified this using SQLConf.get.datetimeJava8ApiEnabled rather than passing around isJava8Time flag, if that's more preferable as it results in a smaller diff.

tom-s-powell avatar Oct 05 '23 20:10 tom-s-powell

Any update on when this change could be reviewed? Perhaps @sfc-gh-bli you'd be able to take a look?

tom-s-powell avatar Nov 17 '23 09:11 tom-s-powell

@sfc-gh-sshankar @sfc-gh-ema @sfc-gh-bli is this something either of you are able to look at? This is currently blocking our ability to use the Snowflake Spark connector with the latest Java 8 API for dates and timestamps.

tom-s-powell avatar Jan 05 '24 09:01 tom-s-powell

Going to close this given https://issues.apache.org/jira/browse/SPARK-38437.

tom-s-powell avatar Apr 22 '24 11:04 tom-s-powell