Marko Grujic

feat: add stats to convert-to-delta operation

2

# Description Collect stats during conversion of a parquet dir to a Delta table and add to the actions. # Related Issue(s) Closes #2490 # Documentation

# Description Currently the `ConvertToDeltaBuilder` skips fetching and populating the stats https://github.com/delta-io/delta-rs/blob/81593e919497221a1a08bf8db9d20e8e4a39a8a6/crates/core/src/operations/convert_to_delta.rs#L332-L353 This results in log files missing the min/max/null count statistics. **Use Case** These stats are useful as they...

Further refine the Top K sort operator

13

### Is your feature request related to a problem or challenge? The Top-K operator has recently been added for a specialized use case when encountering `ORDER BY` and `LIMIT` clauses...

This PR introduces a new modality that allows for concurrent pulling and flushing into temp files from input plan's streams, while preserving the former sequential/non-concurrent modality as well (achieved by...

This fixes decimal parse overflow error when writing/parsing stats.