spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

[FEA] `ExecutionPlanCaptureCallback` should support capturing multiple plans

Open andygrove opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. ExecutionPlanCaptureCallback is used in tests to capture query plans and allow them to be inspected but it currently only supports capturing a single query.

When executing queries against Delta Lake tables, the Delta Lake implementation executes many metadata queries behind the scenes, and we currently have no way of capturing those in tests to confirm whether they were executed as intended (such as falling back to CPU).

Describe the solution you'd like I propose that we enhance ExecutionPlanCaptureCallback to support capturing multiple queries.

Describe alternatives you've considered None

Additional context None

andygrove avatar Aug 04 '22 15:08 andygrove