datafusion

datafusion copied to clipboard

### Describe the bug Found in #9271 and occurred in the 'datafusion-functions' package. `cargo-fmt` starts at the crate root and traverses submodules to find files, but it does not parse...

jonahgao

Internal_err! is over used in core code and should be replaced with exec_err! or plan_err! in many places

3

### Describe the bug internal_err! is used as a general error macro in many spots in the code where in fact the problem the error is propagating is not caused...

Omega359

Wrong projection after optimize_projections rule

5

### Describe the bug When upgrade latest datafusion from a old version, I found `optimize_projections` rule produce wrong projection. Eg: ```sql create table t(x bigint, y bigint) as values (1,1),...

jiacai2050

Add test to verify issue #9161

1

## Which issue does this PR close? Closes #9161. ## Rationale for this change In issue #9161, the expression `cast(a as int)` in the select list [generated](https://github.com/apache/arrow-datafusion/blob/497cb9d46c6f68de6762998c241d0860072c7909/datafusion/expr/src/expr.rs#L1687) a unqualified column...

jonahgao

feat: replace std Instant with wasm-compatible wrapper

3

## Which issue does this PR close? Relates to https://github.com/apache/arrow-datafusion/issues/7651 and #7652 ## Rationale for this change `std::time::Instant` doesn't work on target `wasm32-unknown-unknown`. It would result in a runtime panic...

waynexia

### Is your feature request related to a problem or challenge? We were unable to publish version 36.0.0 to crates.io due to a circular dependency (https://github.com/apache/arrow-datafusion/issues/9277). We have seen a...

andygrove

### Is your feature request related to a problem or challenge? The partition_by COPY option is multivalued, e.g.: ```sql COPY table to file.parquet (partition_by 'a,b,c') ``` This is handled currently...

devinjdangelo

Implement IGNORE NULLS for window functions

7

### Is your feature request related to a problem or challenge? Now DataFusion lacks the IGNORE NULLS support for Window functions ``` DataFusion CLI v35.0.0 ❯ select lag(a) ignore nulls...

comphead

Panic when reading from partitioned datasets with columns that have `'` in them

1

### Describe the bug There is a bug when reading from partitioned tables that have commas in their names Here is the test https://github.com/apache/arrow-datafusion/blob/b2a04519da97c2ff81789ef41dd652870794a73a/datafusion/sqllogictest/test_files/copy.slt#L109 ### To Reproduce Run this script...

alamb

Draft while I figure out: - [ ] Get tests passing - [ ] Review string rewrite / concat in the rewriter and figure out how/why it is necessary (doesn't...

alamb