Holden Karau

Another possible solution would be to also break up the projection and move the part of the projection which is used in the filter down with the filter unless the...

Do folks have a preference between this approach & the one in https://github.com/apache/spark/pull/46143 ?

CC @cloud-fan do you have thoughts / cycles?

Let me take a look at the with functionality but that sounds potentially reasonable.

Oh yes, sorry it's been a busy quarter. Let me try and schedule some review time tomorrow / next week (and do please feel free to ping me again if...

I like it, one small note around the API change

My bad github staged my review comment for some reason, should be visible now.

Yeah if theres interest in this maybe I'll take a crack it over the winter break, I've got a new server on with 8tb of NVMe and another 8tb of...

We've upgraded! Sorry it took so long.

LGTM I'll merge this now to the current dev branch.