datafusion

datafusion copied to clipboard

Move Covariance (Population) covar_pop to be a User Defined Aggregate Function

2

## Which issue does this PR close? Closes #10389 . ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are...

yyy1000

[draft] Add `LogicalType`, try to support user-defined types

8

## Which issue does this PR close? Closes #7923 . Current Pull Request is an Experimental Demo for Validating the Feasibility of Logical Types ## Rationale for this change ##...

yukkit

Remove `Expr::GetIndexedField` and `GetFieldAccess` and always use function `get_field` for indexing

2

### Is your feature request related to a problem or challenge? Discussion starts from https://github.com/apache/datafusion/issues/10181#issuecomment-2071274206 ### Describe the solution you'd like As title mentioned, use function instead of `Expr` ###...

jayzhan211

DataFusion weekly project plan (Andrew Lamb) - May 6, 2024

3

Follow on to https://github.com/apache/datafusion/issues/10283 My (personal) North ⭐ : 1000 projects are built using DataFusion 📈 **It would be great for other contributors to DataFusion who plan non trivial work...

alamb

Auto-update mechanism for dataframe test

6

### Is your feature request related to a problem or challenge? While working on #10364, I found that changing the result in the rust test is quite painful. Currently, we...

jayzhan211

DISCUSSION: remove `CREATE EXTERNAL TABLE` syntax: `DELIMITER`, `WITH HEADER ROW` and `COMPRESSION`

6

### Is your feature request related to a problem or challenge? `CREATE EXTERNAL TABLE` (see [docs](https://datafusion.apache.org/user-guide/sql/ddl.html#create-external-table)) has several syntax items that only make sense for certain formats, specifically ```text CREATE...

alamb

Support custom SchemaAdapter on ParquetExec

2

### Is your feature request related to a problem or challenge? This is a feature request to allow the ParquetExec type to accept a SchemaAdapter instead of having a fixed...

HawaiianSpork

Use `min_value` and `max_value` on statistics to avoid `ExecutionPlan.execute`

11

### Describe the bug Maybe related to #5535, but I couldn't find anything identical, so created a fresh issue. If this is a known bug and you think the fix...

samuelcolvin

Substrait integration doesn't recognize typed functions

2

### Describe the bug Since https://github.com/substrait-io/substrait/pull/537, the standard has declared that functions must be named with compound names consisting of both the function and its types. For example, for the...

Blizzara

Make `CommonSubexprEliminate` faster by avoiding the use of strings

12

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/5637 One of the optimizer passes is "common subexpression elimination" that removes redundant computation However, as @peter-toth...

alamb