spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard
verified publisher icon NVIDIA

[FEA] [JSON] Support timeParserPolicy=LEGACY when parsing dates and timestamps in `from_json`

Open andygrove opened this issue 2 years ago • 1 comments

Is your feature request related to a problem? Please describe. PR https://github.com/NVIDIA/spark-rapids/pull/9666 adds support for parsing dates in from_json but falls back to CPU for timeParserPolicy=LEGACY.

Describe the solution you'd like We should add support for timeParserPolicy=LEGACY.

Describe alternatives you've considered

Additional context

andygrove avatar Nov 17 '23 13:11 andygrove

The implementation of JsonToStructs and ScanJson have been combined, so now we need to validate this for both of them.

revans2 avatar Mar 14 '24 16:03 revans2