datafusion

datafusion copied to clipboard

Create fixed size list table with syntax <type name>[<length>]

6

### Is your feature request related to a problem or challenge? To create a table with fixed size list, we can only do it by casting ``` statement ok CREATE...

jayzhan211

Optimization: Avoid sort for already sorted Parquet files that do not overlap values on condition

8

### Describe the bug I'm testing performance of querying a number of Parquet files, where I can make some assumptions about the Parquet files. - Each Parquet file is already...

simonvandel

Implement a way to preserve partitioning through `UnionExec` without losing ordering

3

### Is your feature request related to a problem or challenge? The `EnforceDistribution` physical optimizer pass in DataFusion in some cases will introduce `InterleaveExec` to increase partitioning when data passes...

alamb

[EPIC] Improving cost calculations and cost based optimizations

7

Design document: https://docs.google.com/document/d/1M4mmV7KA1LSj-D-WJA338B4ydlm-8A8D5OPuDE5_SD4/edit This is a meta issue for improving cost calculations and cost-based optimizations in DataFusion. We already have some statistics collected (mainly from the table sources) and there...

isidentical

Check Cast Expr Before Adding Equivalences

2

## Which issue does this PR close? Closes #9832. ## Rationale for this change Casted columns may lost their ordering. We need check the source and target datatypes to ensure...

berkaysynnada

[feat] Support columns_sorted in row_filters with pageIndex

3

## Which issue does this PR close? Closes #3476 I've picked up here where @Ted-Jiang left off in #3477. I think that I've dealt with some of the [comments](https://github.com/apache/arrow-datafusion/pull/3477#discussion_r972045090). However,...

judahrand

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...

alamb

Stop copying LogicalPlan and Exprs in `ScalarSubqueryToJoin`

1

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...

alamb

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...

alamb

Stop copying LogicalPlan and Exprs in `PushDownLimit`

1

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...

alamb