spline-spark-agent icon indicating copy to clipboard operation
spline-spark-agent copied to clipboard

Attribute dependency not captured for complex plans

Open uday1409 opened this issue 2 years ago • 2 comments

We observed that when there are multiple nested queries along with window functions involved, attribute dependency not properly tracked. For example, avg_monthly_purhcase dependency should point to customer_id and purchase_amount but the link is completely broken. Attaching test queries and generated plan..

SampleQueryWithNestedWindowFunction.txt customerprocess_plan.txt

uday1409 avatar May 01 '23 08:05 uday1409

I will check if I can fix this when I get time. Able to reproduce and have a test query as well

uday1409 avatar Jun 15 '23 12:06 uday1409

thank you @uday1409, your contribution is highly appreciated!

wajda avatar Jun 15 '23 19:06 wajda