m09526

Rust compaction

1

THIS IS AN EXPERIMENTAL PR. NOT READY FOR MERGE. ### Issue Resolves 1359 ### Tests Rust compaction units tests not present yet.

### Background We want to evaluate the performance of recent improvements to Nvidia RAPIDS library on data compactions in Sleeper. ### Description Re-implement data compactions using a GPU based algorithm...

This is the draft implementation for review of adding simple ageoff filtering and very simple min, max, count, sum aggregation. I've opened this for review of the current work before...

### Background Following on from #4344 , we would like to support aggregation of map columns in DataFusion. For example, given | Key |Total | Items | |--|--|--| | a...

Discussion: Design for experimental aggregation support in DataFusion compactions

2

# Background To progress beyond "experimental" status, the DataFusion compaction library in Sleeper must be able to perform the function of "iterators" on in the Java codebase. The most important...