Andrew Lamb

We reverted the change in DF 48: - https://github.com/apache/datafusion/pull/16307 We can focus on fixing it for real for DataFusion 49.0.0 FYI @suibianwanwank would you be willing to take this issue?

I also added this ticket to the list of things we need to do on DataFusion 49 prior to release - https://github.com/apache/datafusion/issues/16235

Thank you @suibianwanwank

On my list for review tomorrow

What I would like to propose for this PR is wait until we have made the next release: #12470 and then we can merge it after that I am thinking...

The 43.0.0 release candidate has been made and we have started voting on it. I merged this branch up from main locally to ensure everything still compiles. It looks good...

I may be misreading this, but it seems like columnize_output_expr is called in a loop for each expression being projected: https://github.com/apache/datafusion/blob/ac827abe1b66b1dfa02ce65ae857477f68667843/datafusion/expr/src/logical_plan/builder.rs#L1505-L1511 However, then for each expr it builds up the...

Thanks for double checking @goldmedal

@chenkovsky has a PR to implement this: - https://github.com/apache/datafusion/pull/17946 It looks perhaps similar to the PIVOT from @simonvandel in - https://github.com/apache/datafusion/pull/17365

> Submitted https://github.com/apache/arrow-rs/pull/6539 for it. @goldmedal would you be ok if I pushed a change to this PR to temporarily patch arrow-rs to include the fix for https://github.com/apache/arrow-rs/pull/6539 ? Then...