datafusion

datafusion copied to clipboard

Create `Struct` table with explicit type and name

2

### Is your feature request related to a problem or challenge? Currently we can build struct table like this ``` statement ok create table t as values (struct(1, 'a')), (struct(2,...

jayzhan211

Fix `Coalesce` casting logic to follows what Postgres and DuckDB do. Introduce signature that do non-comparison coercion

11

## Which issue does this PR close? Closes #10261 Closes #10241 Part of #10507 ## Rationale for this change ## What changes are included in this PR? ## Are these...

jayzhan211

Support skipping comments in `CsvReader`

1

It would be great if datafusion had out-of-the-box support for skipping comment lines. While non of this is "standardized" many CSV readers support skipping full comment lines. An often used...

bbannier

Validate ScalarUDF output rows and support nulls for `array_has` and `get_field` for `Map`

2

## Which issue does this PR close? Closes #5735. Add a small constraint for each UDF to have the same input and output size, with "arrow_typeof" as an exception 2...

duongcongtoai

## Which issue does this PR close? Relate #10040 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

Weijun-H

feat: add static_name() to ExecutionPlan

2

## Which issue does this PR close? Closes #10246 ## Rationale for this change Add `static_name()` method to make the name of an execution plan accessible without constructing the struct....

waynexia

Support for filtered arrow datasets

1

It seems like DataFusion doesn't support working with filtered pyarrow datasets even if other engines do: ```python from pathlib import Path import shutil import polars as pl from deltalake import...

adriangb

## Which issue does this PR close? Closes https://github.com/apache/datafusion/issues/10251 ## Rationale for this change See https://github.com/apache/datafusion/issues/10251 -- keeps it clear what used to be in these positions ## What changes...

alamb

## Which issue does this PR close? Closes #10013. ## Rationale for this change In the following query syntax, `SELECT select_list FROM table_expression ORDER BY expressions`, the order-by expressions can...

jonahgao

select multiple columns in a single `Expr`

22

### Is your feature request related to a problem or challenge? I want to create a udf that can select multiple functions at once, such as a `COLUMNS()` function. `select...

universalmind303