datafusion
datafusion copied to clipboard
apache
Apache DataFusion SQL Query Engine
### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...
### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/9637 As part of making the planner faster, we are updating the optimizer passes to avoid copying...
### Is your feature request related to a problem or challenge? Per https://www.apache.org/foundation/board/reporting, for the first three months of a project it should submit monthly board reports to the ASF...
### Is your feature request related to a problem or challenge? ```shell DataFusion CLI v37.1.0 > select * from number; +----+----+----+ | c0 | c1 | c2 | +----+----+----+ |...
## Which issue does this PR close? Closes #10423 . ## Rationale for this change ## What changes are included in this PR? Add `VariadicCoercion`, `UniformCoercion` Remove `VariadicEqual` (coercion rule...
## Which issue does this PR close? Closes #9945. ## Rationale for this change https://github.com/apache/datafusion/blob/4bd7c137e0e205140e273a7c25824c94b457c660/datafusion/core/src/datasource/listing_table_factory.rs#L67-L73 These lines of `ListingTableFactory.create()` overwrites the config options by `cmd` (CreateExternalTable options). Configs coming from...
### Describe the bug When reading a partition of big NDJSON files compressed with ZSTD there is an error appears. `Error: Custom { kind: Other, error: External(ArrowError(ExternalError(IoError(Custom { kind: Other,...
### Is your feature request related to a problem or challenge? Consider we have huge data source consists of many record batches. Now it's impossible to get last recent N...
## Which issue does this PR close? Related to https://github.com/apache/datafusion/issues/10291 ## Rationale for this change While reviewing this code for https://github.com/apache/datafusion/issues/10291 I found several places the doc comments could be...
## Which issue does this PR close? Revert #10333 related to https://github.com/apache/datafusion/issues/10280 ## Rationale for this change This issue is to be revisited after #10413. ## What changes are included...
