datafusion

datafusion copied to clipboard

The `limit` info lost in the AggregateExec when ser/deser the physical plan

6

### Describe the bug In the definition of `AggregateExec`, we have the `limit` argument to optimize the agg operation. ``` pub struct AggregateExec { ..... /// Set if the output...

liukun4515

Since this is testing `plan_to_sql` it might make more sense to put it with the rest of the tests for plan_to_sql: https://github.com/apache/datafusion/blob/main/datafusion/sql/tests/sql_integration.rs#L4669 However, the fact that those tests don't have...

alamb

fix: use total ordering in the min & max accumulator for floats

3

## Which issue does this PR close? Closes #8031 ## Rationale for this change See the motivating issue. ## What changes are included in this PR? The `MinAccumulator` and `MaxAccumlator`...

westonpace

## Which issue does this PR close? Related to https://github.com/apache/datafusion/pull/10627 and https://github.com/apache/datafusion/issues/8031 ## Rationale for this change While looking at https://github.com/apache/datafusion/pull/10627 from @westonpace I couldn't find any existing tests for...

alamb

[EPIC] Support converting Exprs and LogicalPlans --> SQL Strings

4

This ticket tracks various tickets related to converting `Exprs` and `LogicalPlan`s to/from `SQL` strings - [ ] https://github.com/apache/arrow-datafusion/issues/8736 - [ ] https://github.com/apache/arrow-datafusion/issues/8661 - [x] https://github.com/apache/arrow-datafusion/issues/9726 - [x] https://github.com/apache/arrow-datafusion/issues/9495 - [x]...

alamb

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9494 In https://github.com/apache/datafusion/pull/10573 @goldmedal made expressions from the DataFusion SQL unparser (aka expr --> String) nicer. However...

alamb

Improve performance of extracting statistics from parquet files

1

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/10453 @Lordworms added a benchmark for extracting statistics from parquet files in https://github.com/apache/datafusion/pull/10610 As this code can...

alamb

Updates the requirements on [substrait](https://github.com/substrait-io/substrait-rs) to permit the latest version. Release notes Sourced from substrait's releases. v0.34.0 Chore (BREAKING) bump substrait from 0.48.0 to 0.49.0 Bumps substrait from 3dc77ae to...

dependabot[bot]

### Is your feature request related to a problem or challenge? I have a user defined table function `FlattenTableFunc` whice needs reading data from other table provider. To serialize execution...

lewiszlw

Incorrect statistics read for struct array in parquet

1

### Describe the bug I found this while adding tests https://github.com/apache/datafusion/pull/10608. The statistics of struct array returns nothing ### To Reproduce See `test_struct` in https://github.com/apache/datafusion/pull/10608 ### Expected behavior Return some...

NGA-TRAN