dask-sql
dask-sql copied to clipboard
[ENH] Implement TopK optimization
Is your feature request related to a problem? Please describe. DataFusion 13.0.0 will have new optimizations for TopK queries as described in https://godatadriven.com/blog/optimizing-topk-queries-in-datafusion/
Describe the solution you'd like
Leverage this in Dask SQL if possible. SortExec has a new fetch attribute that we would need to respect.
Describe alternatives you've considered None
Additional context None