datafusion

datafusion copied to clipboard

Substrait doesn't support alias in projection

2

### Describe the bug SQLs like these will fail: ```sql SELECT a as alias_a, a FROM data; ``` or ```sql SELECT a as alias_a FROM data ORDER BY a; ```...

waynexia

Implement statistics support for Substrait

6

### Is your feature request related to a problem or challenge? A report from Twitter https://twitter.com/mim_djo/status/1740542585410814393 Says: > a new release of #datafusion 34, still reading #Deltatable via arrow is...

alamb

feat: continue visit children expr of short-circuit expr

1

## Which issue does this PR close? Closes #. ## Rationale for this change Recently. I find that some common subexpr doesn't be eliminated via `CommonSubexprEliminate` optimizer. for example below...

zhuliquan

Convert `Grouping` to UDAF

4

### Is your feature request related to a problem or challenge? Similar to other issues in #8708 ### Describe the solution you'd like _No response_ ### Describe alternatives you've considered...

jayzhan211

Return TableProviderFilterPushDown::Exact when Parquet Pushdown Enabled

6

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** A clear and concise description of what the problem is. Ex. I'm...

tustvold

[EPIC] Substrait: Add producer and consumer for physical plans

3

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** I would like to use substrait with physical plans. I plan on...

andygrove

## Which issue does this PR close? Part of #8708 ## Rationale for this change This is need when we are moving `arrag_agg` (#11045) to udaf where one of the...

eejbyfeldt

Add example for writing an `AnalyzerRule`

7

### Is your feature request related to a problem or challenge? We have an example for writing a user defined optimizer rule in https://github.com/apache/datafusion/blob/3773fb7fb54419f889e7d18b73e9eb48069eb08e/datafusion/core/tests/user_defined/user_defined_plan.rs#L251 However, we don't have a corresponding...

alamb

Allow providing Arrow schema when scanning Parquet files

1

### Is your feature request related to a problem or challenge? When scanning Parquet files, we'd often like to provide an expected schema, since: 1. The Parquet files might not...

wjones127

Support comparison operators on nested data types (Struct, List, ..)

2

### Is your feature request related to a problem or challenge? We're working on running some used-to-be-Spark pipelines through DataFusion. One case we've noticed where DataFusion doesn't support something is...

Blizzara