datafusion

datafusion copied to clipboard

[Epic] Unify `WindowFunction` Interface (remove built in list of `BuiltInWindowFunction` s)

5

### Is your feature request related to a problem or challenge? For many of the same reasons as listed on https://github.com/apache/arrow-datafusion/issues/8045, having two types of aggregate functions ("built in" --[BuiltInWindowFunction](https://docs.rs/datafusion/latest/datafusion/logical_expr/window_function/enum.BuiltInWindowFunction.html#)...

alamb

Remove unnecessary null checks in `GroupColumn`s

5

### Is your feature request related to a problem or challenge? As mentioned by @Dandandan in https://github.com/apache/datafusion/pull/12809#discussion_r1801678804 Some null checks are actullay unnecessary for arrays containing no nulls (basically we...

Rachelint

feat: support inner iejoin

4

## Which issue does this PR close? ref #8393 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

my-vegetable-has-exploded

### Describe the bug In some logical plans, `.derive()` creates a new subquery as a derived table like `FROM (SELECT ...)`. In MySQL, every derived table requires an alias. `.derive()`...

peasee

`to_parquet` with path not ending in a slash writes to a file instead of a directory since v36

3

### Describe the bug `Dataframe::to_parquet` takes a path as string, and used to create a directory and write files to it, even if it did not end with `/`. Starting...

progval

[EPIC] Automatically generate all function content from code

7

### Is your feature request related to a problem or challenge? Currently, when we add a new function to DataFusion library we have to remember to document that function in...

alamb

Draft as it builds on https://github.com/apache/datafusion/pull/12847 ## Which issue does this PR close? Part of #12114 ## Rationale for this change As @Rachelint points out https://github.com/apache/datafusion/pull/12847#discussion_r1803436799 the current coverage of...

alamb

Improve `AggregateFuzz` testing: generate random queries

2

## Which issue does this PR close? Part of https://github.com/apache/datafusion/issues/12114 ## Rationale for this change Now that we have a great aggregation fuzz testing framework from @Rachelint , lets use...

alamb

### Describe the bug As pointed here: https://github.com/apache/datafusion/pull/12946/files#r1803027063 window frame definition `SUM(id) OVER (PARTITION BY first_name ROWS BETWEEN 5 PRECEDING AND 2 FOLLOWING)` is incorrectly unparsed as `SUM(id) OVER (PARTITION...

sgrebnov

Enable reading `StringViewArray` by default from Parquet

17

Draft as it builds on: - [x] Debug tests - [x] File issues found - [x] https://github.com/apache/datafusion/pull/12724 - [x] https://github.com/apache/datafusion/pull/12792 - [ ] https://github.com/apache/datafusion/pull/12816 @goldmedal - [x] https://github.com/apache/datafusion/pull/12809 from @Rachelint...

alamb