dask-sql icon indicating copy to clipboard operation
dask-sql copied to clipboard

[ENH] Implement TopK optimization

Open andygrove opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. DataFusion 13.0.0 will have new optimizations for TopK queries as described in https://godatadriven.com/blog/optimizing-topk-queries-in-datafusion/

Describe the solution you'd like Leverage this in Dask SQL if possible. SortExec has a new fetch attribute that we would need to respect.

Describe alternatives you've considered None

Additional context None

andygrove avatar Sep 28 '22 17:09 andygrove