datafusion

datafusion copied to clipboard

[Epic] Implement support for `StringView` in DataFusion

5

### Is your feature request related to a problem or challenge? `StringView` / `BinaryView` were added to the Arrow format that make it more suitable for certain types of operations...

alamb

Do we need to escape search string as it's used in regexp? Wondering what's the result of `contains("abcdefg", ".*")`

6

Do we need to escape search string as it's used in regexp? Wondering what's the result of `contains("abcdefg", ".*")` _Originally posted by @waynexia in https://github.com/apache/datafusion/pull/10879#discussion_r1635767599_

alamb

### Is your feature request related to a problem or challenge? Tracking ticket for next release, also a place to track desired inclusions Last release was https://crates.io/crates/datafusion/39.0.0 (June 10, 2024)...

alamb

Convert list operator to function in `sql_expr_to_logical_expr`

2

Like what we have done for `[] -> MakeArray`. It is possible to have the similar conversion for other List Operator in the early stage (Sql to LogicExpr). - List...

jayzhan211

Make Eq with negative float zero compat with other engines

1

### Describe the bug DF returns false below and is not compliant with major engines: ``` DataFusion CLI v39.0.0 > select 0.0 == -0.0; +--------------------------+ | Float64(0) = Float64(-0) |...

kazuyukitanimura

Complete Possible Join Type Handling for EmptyRelation Propagation Rule

13

### Is your feature request related to a problem or challenge? Currently on `main` only the `Inner` join type is considered when doing EmptyRelation propagation, but it's possible to infer...

tshauck

Incorrect LEFT JOIN evaluation result on OR conditions

7

### Describe the bug When the matching condition is on columns and combined with `OR`, the result retuned by `LEFT JOIN` is similar to `INNER JOIN`, which is incorrect. `LEFT...

appletreeisyellow

Substrait: Add SubqueryAlias support

4

### Is your feature request related to a problem or challenge? If there is a `SubqueryAlias` relation, `datafusion-substrait` will bypass it. This works for the producer, the generated Substrait plans...

nseekhao

Presentation about DataFusion at Microsoft GSL (Gray Systems Lab)

2

I was invited to speak at https://www.microsoft.com/en-us/research/group/gray-systems-lab/ which is a product focused R&D group at Microsoft The talk is Tuesday June 25 at 10:30 AM PT at the the Microsoft...

alamb

Potential memory issue when using COPY with PARTITIONED BY

5

### Describe the bug Memory does not get freed after executing multiple `COPY ... TO ... PARTITIONED BY ...` queries. I have not been able to identify what is causing...

hveiga