datafusion

datafusion copied to clipboard

Support substrait serialization for `ScalarValue::Utf8View` and `ScalarValue::BinaryView`

5

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/11752 We are trying to enable DataFusion to use StringViewArray by default. If we do that it...

alamb

## Which issue does this PR close? N/A ## Rationale for this change Small follow on to https://github.com/apache/datafusion/pull/12157 from @devanbenz It is still somewhat awkward to make RuntimeEnv's, so let's...

alamb

## Which issue does this PR close? part of https://github.com/apache/datafusion/issues/11502. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are...

lewiszlw

Remove Sort expression (`Expr::Sort`)

6

Remove sort as an expression, i.e. remove `Expr::Sort` from `Expr` enum. Use `expr::Sort` directly when sorting. The sort expression was used in context of ordering (sort, topk, create table, file...

findepi

## Which issue does this PR close? Follow up to [observation made on this PR](https://github.com/apache/datafusion/pull/12199#discussion_r1733416035). ## Rationale for this change Test coverage for current behavior of `arrow_cast` with Utf8View and...

wiedld

fix: nested loop join requires outer table to be a FusedStream

2

## Which issue does this PR close? Closes #12187 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? Yes ## Are...

YjyJeff

feat: Enforce the uniqueness of map key name for the map/make_map function

2

## Which issue does this PR close? Closes #11437 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

Weijun-H

`expr::Sort` had `Box` because Sort was also an expression (via `expr::Expr::Sort`). This has been removed, obsoleting need to use a `Box`. Extracted from and based on https://github.com/apache/datafusion/pull/12177 to reduce PR...

findepi

fix(optimizer): optimize_projections rule bug

9

## Which issue does this PR close? Closes https://github.com/apache/datafusion/issues/12183 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

JasonLi-cn

Improve binary scalars display

1

## Which issue does this PR close? Closes #. ## Rationale for this change Binary scalars might be large, which makes plan printing so long. ## What changes are included...

lewiszlw