spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

Qualification tool: Parse expressions in Join execs

Open nartal1 opened this issue 2 years ago • 2 comments

This closes https://github.com/NVIDIA/spark-rapids/issues/6064 This PR adds parser support to the following join execs.

  1. BroadcastHashJoin
  2. SortMergeJoin
  3. BroadcastNestedLoopJoin
  4. ShuffledHashJoin

The format in eventlog is almost similar for equijoins. All use same function to parse the exec. Added new test for unsupported expressions and updated the current test for supported expressions.

nartal1 avatar Oct 14 '22 00:10 nartal1

build

nartal1 avatar Oct 14 '22 00:10 nartal1

build

nartal1 avatar Oct 18 '22 01:10 nartal1

build

tgravescs avatar Oct 19 '22 14:10 tgravescs

build

nartal1 avatar Oct 19 '22 20:10 nartal1

build

nartal1 avatar Oct 20 '22 16:10 nartal1