datafusion

datafusion copied to clipboard

~Draft as it builds on https://github.com/apache/datafusion/pull/10427~ ## Which issue does this PR close? Part of https://github.com/apache/datafusion/issues/10287 ## Rationale for this change I am trying to avoid copying as much in...

alamb

Add more sqllogictests for `parquet_sorted_statistics`

3

## Which issue does this PR close? Part of #10336 . ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ##...

yyy1000

Draft as it builds on * https://github.com/apache/datafusion/pull/10410 * https://github.com/apache/datafusion/pull/10427 * https://github.com/apache/datafusion/pull/10430 ## Which issue does this PR close? Closes https://github.com/apache/datafusion/issues/10287 ## Rationale for this change Make planning faster by avoiding...

alamb

During expression equality, check for new ordering information

1

## Which issue does this PR close? Closes #. ## Rationale for this change See [issue #9812](https://github.com/apache/datafusion/issues/9812) for rationale. ## What changes are included in this PR? When an equality...

mustafasrepo

## Which issue does this PR close? Part of https://github.com/apache/datafusion/issues/9637 ## Rationale for this change `LogicalPlan::recompute_schema` is needed for several subtasks of https://github.com/apache/datafusion/issues/9637 (for example https://github.com/apache/datafusion/pull/10356 and https://github.com/apache/datafusion/pull/10405) I felt...

alamb

EnforceDistribution fails, seems to turn all the types of the schema to UInt64

6

### Describe the bug This happens in 37 it works in 36 EnforceDistribution fails with `"PhysicalOptimizer rule 'EnforceDistribution' failed, due to generate a different schema, original schema:` ### To Reproduce...

fabianmurariu

## Which issue does this PR close? Implement `get_flight_info_tables` and remove unimplemented methods. ## Rationale for this change ## What changes are included in this PR? ## Are these changes...

lewiszlw

`stride` is not optional for new `array_slice` UDF

6

### Describe the bug The `array_slice` UDF takes 4 parameters. https://github.com/apache/datafusion/blob/96487ea0cbb7901a1e4aa18fdf6deb8961319fea/datafusion/functions-array/src/extract.rs#L55-L61 Which means that `args.len()` is always 4 in `array_slice_inner`, even when called with `stride = Expr::Null` or `stride =...

Michael-J-Ward

Support "User defined coercion" rules

2

### Is your feature request related to a problem or challenge? DataFusion automatically "coerces" (see [docs here](https://docs.rs/datafusion/latest/datafusion/logical_expr/type_coercion/index.html)) input argument types to match the types required of operations or functions. For...

alamb

## Which issue does this PR close? Closes #. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

duongcongtoai