spark
spark copied to clipboard
[SPARK-48162][SQL] Add collation support for MISC expressions
What changes were proposed in this pull request?
Introduce collation awareness for misc expressions: raise_error, uuid, version, typeof, aes_encrypt, aes_decrypt.
Why are the changes needed?
Add collation support for misc expressions in Spark.
Does this PR introduce any user-facing change?
Yes, users should now be able to use collated strings within arguments for misc functions: raise_error, uuid, version, typeof, aes_encrypt, aes_decrypt.
How was this patch tested?
E2e sql tests.
Was this patch authored or co-authored using generative AI tooling?
No.
Could you take a look at the UT failures?
[info] *** 14 TESTS FAILED ***
[error] Failed tests:
[error] org.apache.spark.sql.connect.planner.SparkConnectServiceSuite
[error] org.apache.spark.sql.connect.ProtoToParsedPlanTestSuite
thanks, merging to master!