Andrew Lamb

I also added this to the list of things to document on DataFusion 50.0.0: https://github.com/apache/datafusion/issues/16799

> not sure if it will help direction, cost nothing to share :) [Debunking the Myth of Join Ordering: Toward Robust SQL Analytics](https://arxiv.org/abs/2502.15181) I have that paper on my reading...

In case others haven't heard, @irenjj is working on additional subquery support as part of a Google Summer of Code Project (where @jayzhan211 and I are helping mentor). I am...

Update: - @irenjj is tracking his project here: https://github.com/apache/datafusion/issues/16059 I think the first thing we will be focusing on is a more general framework for decorrelation - https://github.com/apache/datafusion/issues/5492

I have seen @irenjj / @duongcongtoai / @UBarney / @jonathanc-n working on this @xudong963 (a DataFusion committer and PMC member) has experience in this area and may have additional time...

> FYI, I just followed the latest paper from TUM, "Improving Unnesting of Complex Queries", and will learn about the current code in DF and read the latest PRs in...

> Currently, q23 takes approximately 6 seconds to execute. I have confirmed that DataFusion does not have the aforementioned optimizations and still scans a very large number of rows and...

FYI @pepijnve this is perhaps relevant to you as you have been working closely with tokio / tokio runtimes

> @alamb thanks for the pointer. > > Related to this work specifically, is there any guidance on using something like Tokio console with DataFusion? I was about to start...

Thanks @adriangb and @Omega359 for the help with this one (and to @tustvold for / @ion-elgreco for the underlying feature) It's taken a while but we have made it