Devin D'Angelo

Thank you everyone who has contributed so far :pray:. I just filed a PR to update datafusion-federation to point upstream for plan->SQL going forward https://github.com/datafusion-contrib/datafusion-federation/pull/30. The additional expr implementations upstream...

The `SpawnedTask` abstraction looks great! Agreed that your API is more intuitive and `Vec` is sufficient without an additional wrapper. Thanks again for knocking this out!

@alamb I opened #7298 to track improving statement level options/overrides relevant to this epic.

An additional issue we should cut and add to this epic is allowing inserts to a sorted ListingTable. In the case of appending new files to a directory, I think...

@alamb I opened #7442 to track adding support for parquet column level settings via SQL options.

I added #7679 to track adding avro support for writes @alamb

@alamb I made some progress on inserts to sorted tables https://github.com/apache/arrow-datafusion/issues/7354 This also got me thinking about inserts to partitioned tables, so I opened issue to track: https://github.com/apache/arrow-datafusion/issues/7744 Lastly, I've...

@alamb I wrote up an issue describing what we discussed on #7743 regarding empty files being written out and some potential solutions. https://github.com/apache/arrow-datafusion/issues/7767

I am interested in taking a look at this. I was able to reproduce the error using the example above: ```rust Error: Substrait("Unsupported plan in Substrait physical plan producer: MemoryExec:...

I looked into the example and the physical plan substrait producer/consumer code. Unfortunately for physical plans, the subtrait consumer and producer are only implemented for `ParquetExec` and even then they...