datafusion

datafusion copied to clipboard

### Is your feature request related to a problem or challenge? I'm finding slightly confusing how to output the schema of particular query, the workaround I use is ``` >...

comphead

Reduce page metadata loading to only what is necessary for query execution in ParquetOpen

25

### Is your feature request related to a problem or challenge? The ParquetOpen will load all page metadata for a file, on an all tasks concurrently accessing that file. This...

adrian-thurston

Update all github workflow to use actions tied to sha hashes

6

### Is your feature request related to a problem or challenge? A recent [supply chain attack](https://arstechnica.com/information-technology/2025/03/supply-chain-attack-exposing-credentials-affects-23k-users-of-tj-actions/) has made it extremely apparent that github workflows should only use actions that are...

Omega359

Eliminate Self Joins

3

This PR implents two `EliminateAggregationSelfJoin` and `EliminateUniqueKeyedSelfJoin` optimization rules. As the name suggests these optimizations eliminate self joins when the expression returned can be rewritten more efficently with a window...

atahanyorganci

Implement Single Join

2

### Is your feature request related to a problem or challenge? This is part of #13181 for looking into different joins. ## What is a Single Join Single joins are...

jonathanc-n

Evaluate filter pushdown against the physical schema for performance and correctness

14

### Describe the bug Consider the following test: ```sql COPY ( SELECT arrow_cast(a, 'Int16') AS a FROM ( VALUES (1), (2), (3) ) AS t(a) ) TO 'test_files/scratch/parquet_filter_pushdown/parquet_table/1.parquet' STORED AS...

adriangb

Support bounds evaluation for temporal data types

17

## Which issue does this PR close? As discussed in [14237](https://github.com/apache/datafusion/issues/14237) temporal data types should be supported in bounds evaluation. - Closes #14237. ## Rationale for this change We want...

ch-sc

wip: proto to physical plan conversion

2

## Which issue does this PR close? - Closes https://github.com/apache/datafusion/issues/14082. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are...

jatin510

updatted github action by change version tag to sha hashes

5

## Which issue does this PR close? - Closes [#15298](https://github.com/apache/datafusion/issues/15298). ## Rationale for this change This update strengthens the security of GitHub workflows by substituting version tags with precise SHA...

Jiashu-Hu

refactor!: consistent null handling in coercible signatures

3

## Which issue does this PR close? - Closes #15013. ## Rationale for this change Currently, there is a special case for null handling in `TypeSignatureClass::matches_native_type`, which causes inconsistencies and...

alan910127