Andrew Lamb

I think it means https://github.com/apache/arrow-datafusion/pull/68

I think a conversion crate would be valuable indeed, though I don't have time to work on such a thing now. We could potentially host it in the https://github.com/datafusion-contrib organization...

> You miss out on a valid naming option: arrow2arrow 😜 🤯 lol

I for one would be very supportive of getting some/all of this implementation back into the main arrow/rust implementation. I realize doing so is lots of work -- not just...

I agree having a separate python binding for Ballista in the location suggested by @djKooks in apache/arrow-ballista#15 makes sense to me

I do not have any more to add here -- since I don't use the python bindings myself I don't have a lot to offer with specifics

Somewhat of a tangent for this discussion, but my project (https://github.com/influxdata/influxdb_iox) is also interested in time to first result (aka streaming) execution, as well as the lower resource (memory) usage...

For spark integration, check out https://github.com/blaze-init/blaze by @yjshen In terms of the current status of the Plasma project I think you may have to ask on the [email protected] list --...

> What can do apache spark good? One major advantage is that it is very mature (so has many feature, documentation, integrations, etc -- such as `spark-shell`)

The lack of ballista coverage in CI came up again with @gaojun2048 @liukun4515 and @mingmwang on https://github.com/apache/arrow-datafusion/pull/2070#discussion_r834104400