datafusion
datafusion copied to clipboard
apache
Apache DataFusion SQL Query Engine
### Is your feature request related to a problem or challenge? The Top-K operator has recently been added for a specialized use case when encountering `ORDER BY` and `LIMIT` clauses...
### Describe the bug Me again.. I'm getting a panic from https://github.com/apache/datafusion/blob/cafbc9ddceb5af8c6408d0c8bbfed7568f655ddb/datafusion/physical-expr/src/analysis.rs#L95 I'm not exactly sure yet what's causing it, I'll give more details when I get them. I must...
Converted internal representation of LogicalPlanBuilder from LogicalPlan to Arc<LogicalPlan> #10485
Converted internal representation of LogicalPlanBuilder from LogicalPlan to Arc #10485 ## Which issue does this PR close? Closes #10485 . ## Are these changes tested? Covered by existing tests
## Which issue does this PR close? Closes https://github.com/apache/datafusion/issues/10488 ## Rationale for this change In InfluxDB IOx, when the inputs of `SortPreservingMerge` are all sorted on the sort key and...
## Which issue does this PR close? Closes #. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...
## Which issue does this PR close? related to #11182 ## Rationale for this change Splitting `FileFormat` implementations out of datafusion-core will help ensure datafusion remains modular and extensible, as...
## Which issue does this PR close? Takes a shot at #10633 . ## Rationale for this change Algorithm adopted from [this](https://stackoverflow.com/a/18403396/16516114) SO answer. ## What changes are included in...
### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/10918 In order to take advantage of the parquet writer generating StringViewArrays ( https://github.com/apache/arrow-rs/issues/5530 from @ariesdevil (❤️...
## Which issue does this PR close? #10653 fixed the name mismatch (substrait's `sum:int32` vs DF's `sum`) for scalar functions, and #10842 fixed it for aggregates. This fixes it for...
### Is your feature request related to a problem or challenge? We have had good luck writing up quarterly updates for DataFusion, most recently: https://arrow.apache.org/blog/2024/01/19/datafusion-34.0.0/ (see https://github.com/apache/arrow-datafusion/issues/6780) ### Describe the...