Cory Grinstead

Results 119 comments of Cory Grinstead

this actually looks like a duplicate of #157

@abhiaagarwal @ion-elgreco those are valid errors. Datafusion added some new optimization rules that break a lot of older plans. I am actively working on getting all of the code upgraded...

@rtyler I'd be happy to contribute to this one. Feel free to assign it to me.

> @universalmind303 I tried creating a reader with polars rust directly but the Scan is not flexible enough to read schema evolved table unfortunately : ( > > So curious...

> What is the update on this? Would also love this to use read/write delta with nodejs , huge unlock with the amount of js devs imo. I had an...

> yup, looking forward to someone submitting a PR to inshellisense to add nushell support. not exactly sure what reedline would need, if anything. While it _could_ be done externally,...

> @universalmind303 are you already working on this? no, feel free to go ahead and work on it if you'd like.

FWIW, https://github.com/apache/datafusion/issues/10102 seems related as multi selection could be implemented via `struct` and `unnest`.

I'm curious, It seems like most of the reasoning behind [Arc\](https://github.com/apache/arrow-datafusion/issues/4628) and `clone` are due to the optimizer stage. Polars uses an intermediate representation `ALogicalPlan` (arena allocated logical plan) solely...

@gdubya I do like the idea of adding delta support, and think it'd be a good fit for the project _(especially considering py & rust have it)_. In the short...