spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

[Audit] Verify GpuCreateNamedStruct works with updated SQL syntax in Spark 3.4

Open NVnavkumar opened this issue 3 years ago • 1 comments

Describe the bug Spark 3.4 updated how field names are preserved and ensured dot-notation and index-notation are equivalent. We should verify that this behavior works in Spark 3.4 with the RAPIDS Accelerator.

Spark commit - https://github.com/apache/spark/commit/e5914e199c

NVnavkumar avatar Oct 10 '22 20:10 NVnavkumar

From looking at the patch and the code for GPuCratedNamedStruct I don't think we will be impacted. The name of each field is passed into the constructor. But this is just to add a test to verify it, and that should be relatively simple to do.

revans2 avatar Oct 11 '22 17:10 revans2