spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

[FEA] Fix Databricks failed cases when Time zone is non-UTC

Open res-life opened this issue 1 year ago • 2 comments

Is your feature request related to a problem? Please describe. Spark-Rapids currently does not support legacy rebase mode when TZ is non-UTC.

For non-UTC time zone, DB failed some cases because of DB default timestamp rebase mode is legacy which is different with regular Spark.

Describe the solution you'd like

  • [ ] Fix existing cases
  • [ ] Add cases that do not rely on default mode: Testing all the rebase mode.

Describe alternatives you've considered

Additional context

res-life avatar Nov 20 '23 07:11 res-life