spark icon indicating copy to clipboard operation
spark copied to clipboard

[SPARK-48162][SQL] Add collation support for MISC expressions

Open uros-db opened this issue 1 year ago • 1 comments

What changes were proposed in this pull request?

Introduce collation awareness for misc expressions: raise_error, uuid, version, typeof, aes_encrypt, aes_decrypt.

Why are the changes needed?

Add collation support for misc expressions in Spark.

Does this PR introduce any user-facing change?

Yes, users should now be able to use collated strings within arguments for misc functions: raise_error, uuid, version, typeof, aes_encrypt, aes_decrypt.

How was this patch tested?

E2e sql tests.

Was this patch authored or co-authored using generative AI tooling?

No.

uros-db avatar May 08 '24 04:05 uros-db

Could you take a look at the UT failures?

[info] *** 14 TESTS FAILED ***
[error] Failed tests:
[error] 	org.apache.spark.sql.connect.planner.SparkConnectServiceSuite
[error] 	org.apache.spark.sql.connect.ProtoToParsedPlanTestSuite

dongjoon-hyun avatar May 08 '24 16:05 dongjoon-hyun

thanks, merging to master!

cloud-fan avatar May 15 '24 06:05 cloud-fan