Daniël Heres comments

Results 167 comments of


                                            Daniël Heres

extract OR clause for join

Hm getting different results now - may have been something running in the background on my machine - will update the results accordingly

extract OR clause for join

Ok - updated the benchmark results - looks good to go now!

extract OR clause for join

Thanks @AssHero @alamb

make the header not changed when do optimization

Also see #279 #280 for extra context and a proposed implementation

make the header not changed when do optimization

> > Also see #279 #280 for extra context and a proposed implementation > > when are we going to merge or review them？ @Dandandan I think the PR is...

Support Top-K query optimization for `ORDER BY <EXPR> [ASC|DESC] LIMIT n`

I think there are two items here * parallelizing `order by` followed by `limit n`: * implement topk operator Currently a plan looks like the following ``` | physical_plan |...

Support Top-K query optimization for `ORDER BY <EXPR> [ASC|DESC] LIMIT n`

> > Already with the current implementation we should be able to rewrite it to: > > I agree this would help performance. However, it will become irrelevant if/when we...

Support Top-K query optimization for `ORDER BY <EXPR> [ASC|DESC] LIMIT n`

After playing with it a bit more, I think this issue boils down to pushing a limit to `SortPreservingMergeStream` and using it there to only keep top N items instead...

Support Top-K query optimization for `ORDER BY <EXPR> [ASC|DESC] LIMIT n`

So it seems we *mostly* have the benefits of a TopK operator now by pushing down the limit to individual operations. There are a couple of followups possible (will create...

[EPIC] Type-coercion improvements

I added https://github.com/apache/arrow-datafusion/issues/3431 to the list.