polars perf: radix partitioning in single key group-by

perf: radix partitioning in single key group-by

Open ritchie46 opened this issue 2 years ago • 1 comments

We did a full scan per thread to do radix partitioning. This adds a repartition phase that scatters the keys. Will follow up with benchmarks.

Nov 09 '23 11:11 ritchie46

The benchmarks are not definitive here. Though the partitioning phase seems relatively cheap, so I expect we should be able to get on top of this.

Nov 10 '23 08:11 ritchie46

I'm going to close this one as stale. Feel free to re-open of course if you want to continue the work here.

Jun 24 '24 10:06 stinodego