spark-rapids
spark-rapids copied to clipboard
[FEA] Fix Databricks failed cases when Time zone is non-UTC
Is your feature request related to a problem? Please describe. Spark-Rapids currently does not support legacy rebase mode when TZ is non-UTC.
For non-UTC time zone, DB failed some cases because of DB default timestamp rebase mode is legacy which is different with regular Spark.
Describe the solution you'd like
- [ ] Fix existing cases
- [ ] Add cases that do not rely on default mode: Testing all the rebase mode.
Describe alternatives you've considered
Additional context