Daniël Heres

Results 167 comments of Daniël Heres

@iemejia @jorgecarleitao Has the official Rust implementation moved to this repo / space after the donation to Apache? https://github.com/apache/avro/tree/master/lang/rust If so, think it makes sense to update some pointers in...

@jorgecarleitao Some pointers: https://github.com/flavray/avro-rs/issues/189 https://s.apache.org/avro-rust-vote

Thanks @iemejia for the full context and status of the Rust implementation! Getting the Materialize version in seems great. Also let me know when I should give access to `avro-tools`...

> I find this comment: https://github.com/apache/arrow-datafusion/blob/master/datafusion/optimizer/src/projection_push_down.rs#L98-L100 > > It says that `Ensure that we are reading at least one column from the table`. Is there any reason or background of...

> Might `count(*)` be as simple as a stats lookup in Parquet or DeltaLake? Reading a billion values just to count them seems sub-optimal, but that can definitely be addressed...

Draft PR here: https://github.com/apache/arrow-datafusion/pull/3382 It turns out it is a bit more complex than removing a line, as every `Exec` node should support producing records without columns/empty schema. I think...

> Maybe we can teach https://docs.rs/arrow/22.0.0/arrow/datatypes/struct.Schema.html#method.project and https://docs.rs/arrow/22.0.0/arrow/record_batch/struct.RecordBatch.html#method.project about empty projections? Thanks, I did just that yesterday, for `RecordBach::project`: https://github.com/apache/arrow-rs/pull/2691. `Schema::project` already seems to handle empty projections just fine 🎉

@AssHero do you have some numbers, e.g. how much does it help q19? @alamb one thing we might consider is to apply the optimization whenever there is an expensive parent...

@alamb running the benchmarks now for q7 and q19 posting them here when done

~~Looks like performance regressed a bit :/ we probably have a better look before merging it @alamb~~ Looks like roughly a 1.35x speedup on q7 and a smaller 1.16x speedup...