datafusion

datafusion copied to clipboard

### Is your feature request related to a problem or challenge? substrait deprecated `values` field in VirtualTable message and instead added `expressions` in substrait-io/substrait#711. Datafusion should handle both where applicable....

tokoko

## Which issue does this PR close? Closes #12581 ## Rationale for this change ## What changes are included in this PR? This PR allows users to construct `ListingTableUrl` directly...

OussamaSaoudi

Convert `BuiltInWindowFunction::CumeDist` to a user defined window function

3

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/8709 There is now no difference between "built in" / "prepackaged" scalar and aggregate functions in DataFusion,...

jcsherin

EXCEPT ALL returns the wrong number of records

1

### Describe the bug According to the [SQL spec](https://www.contrib.andrew.cmu.edu/~shadow/sql/sql1992.txt), when handling EXCEPT ALL the number of copies returned of a given record is the maximum of 0 OR the number...

vbarua

[EPIC] Schema metadata handling / bugs

2

### Is your feature request related to a problem or challenge? As described by @wiedld on https://github.com/apache/datafusion/pull/12729 > A https://github.com/apache/datafusion/pull/11989 (and released in 42.0.0) has [added a check](https://github.com/apache/datafusion/blob/322d83526909ab44cfbe34b982d1a1c36a4dbe8f/datafusion/core/src/physical_planner.rs#L676) that the...

alamb

POC: Remove unnecessary null check for `GroupColumn`

1

## Which issue does this PR close? Closes #. POC for checking #12944 , not for merged ## Rationale for this change ## What changes are included in this PR?...

Rachelint

Migrate documentation for remaining window functions to window_functions.md

3

### Is your feature request related to a problem or challenge? As part of https://github.com/apache/datafusion/issues/12740 this ticket is to migrate all the existing documentation for the above named functions from...

alamb

### Is your feature request related to a problem or challenge? In https://github.com/apache/datafusion/pull/12269 @jayzhan211 made significant improvements to how group values are stored in multi-column aggregations. There are a few...

alamb

Datafusion fails on simple DISTINCT ON query

1

### Describe the bug Simple SELECT DISTINCT ON query triggers failure in datafusion `Internal error: Failed due to a difference in schemas` ### To Reproduce Open datafusion-cli and run the...

qrilka

Enable reading StringView by default from Parquet (`schema_force_string_view`) by default

7

Part of https://github.com/apache/datafusion/issues/11752 ### Is your feature request related to a problem or challenge? As part of https://github.com/apache/datafusion/issues/10918, @XiangpengHao has threaded the use of `StringView` through parquet, arrow-rs and then...

alamb