datafusion

datafusion copied to clipboard

Refactor protobuf ser/de traits to allow decorator pattern

2

Refactor PhysicalExtensionCodec with &dyn dispatch (Alternative to #19234) Which issue does this PR close? Closes #18477 Related to #19234 - this PR provides an alternative implementation approach. Rationale for this...

adriangb

spark `crc32` need to have custom nullability

1

### Describe the bug the UDF uses the default `is_nullable` which is always true which is not the case ### To Reproduce _No response_ ### Expected behavior _No response_ ###...

rluvaton

Use SortMergeJoinExec consistently in physical plan outputs

2

## Which issue does this PR close? #19238 ## Rationale for this change `SortMergeJoinExec` is currently displayed inconsistently across physical plan formats, see [join.slt](https://github.com/apache/datafusion/blob/20870c18a418ec081d44ecf8a90a30a95aa53138/datafusion/sqllogictest/test_files/joins.slt#L2727) vs. [explain_tree.slt](https://github.com/apache/datafusion/blob/20870c18a418ec081d44ecf8a90a30a95aa53138/datafusion/sqllogictest/test_files/explain_tree.slt#L1203). These examples show that...

xavlee

feat(cli): support external tables on multiple locations

4

## Which issue does this PR close? - Related to https://github.com/apache/datafusion/issues/16303 ## Rationale for this change The commit adds support for creating external tables that can reference multiple file locations....

fpetkovski

Add Local Scripts to Reproduce Full CI and Perform Auto-Fixes

3

### Is your feature request related to a problem or challenge? ### Motivation AI coding agents are now capable of handling many simple, mechanical tasks in DataFusion. When assigning such...

2010YOUY01

Idea: Hosting Compiler Explorer with latest arrow and Datafusion

1

I'm constantly working on optimization in DataFusion and Arrow and I find myself, copy paste a lot of code from Arrow and DataFusion to compiler explorer just to test different...

rluvaton

Refactor protobuf ser/de traits

18

## Relevant issues Closes #18477 ## Motivation The current protobuf serialization/deserialization system in DataFusion has limitations when users need to customize or intercept the serialization process. Specifically: 1. **Limited interception...

adriangb

spark `char` need to have custom nullability

4

### Describe the bug the UDF uses the default `is_nullable` which is always true which is not the case ### To Reproduce _No response_ ### Expected behavior _No response_ ###...

rluvaton

spark `abs` need to have custom nullability

1

### Describe the bug the UDF uses the default `is_nullable` which is always true which is not the case ### To Reproduce _No response_ ### Expected behavior _No response_ ###...

rluvaton

spark `expm1` need to have custom nullability

1

### Describe the bug the UDF uses the default `is_nullable` which is always true which is not the case ### To Reproduce _No response_ ### Expected behavior _No response_ ###...

rluvaton