spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard
verified publisher icon NVIDIA

[Audit] GpuInSet should return false when checking for NULL in empty list

Open NVnavkumar opened this issue 2 years ago • 1 comments

Spark fixed a longstanding bug where NULL in (empty list) returned NULL. For ANSI compliance, this is supposed to return false instead. The GPU needs emulate the same behavior in Spark 3.5.0 and above.

  • https://github.com/apache/spark/commit/db357edb7b
  • Spark-4.0: https://github.com/apache/spark/commit/7741fe79e20

NVnavkumar avatar Oct 12 '23 22:10 NVnavkumar

The Spark change only affects. 4.0+

razajafri avatar Mar 21 '24 19:03 razajafri