Andrew Lamb
Andrew Lamb
I am curious about the rationale to bring it back into apache governance (I am not opposed, but I wonder what the benefits are). Is it related to finding more...
> One reason is that I would like to help maintain the package. I see -- as I recall your employment situation requires ASF governed projects, correct? BTW the move...
For context, the relevant rustsec issue is https://rustsec.org/advisories/RUSTSEC-2021-0122.html
👍 this is an important optimization as `select count(*)` type queries are so common
I think @tustvold has been thinking of this in the context of the various parquet reader improvements
> Remove projection "hack" and delegate to file readers Yes, this is what I was talking about. https://docs.rs/datafusion/latest/datafusion/physical_optimizer/aggregate_statistics/struct.AggregateStatistics.html is very cool 👍 (thanks @rdettai !)
Maybe we can teach https://docs.rs/arrow/22.0.0/arrow/datatypes/struct.Schema.html#method.project and https://docs.rs/arrow/22.0.0/arrow/record_batch/struct.RecordBatch.html#method.project about empty projections?
Shall we merge this document in now that we have run it successfully once?
Marking as draft to signify this PR has planned changes (and make it easier to find PRs that are in need of review). Please mark "ready for review" when it...
> is there any optimization should be done in the logical phase with the Expr:IsTrue? I think the only coercion it might need is that its argument is `DataType::Boolean`