datafusion
datafusion copied to clipboard
apache
Apache DataFusion SQL Query Engine
### Is your feature request related to a problem or challenge? @Omega359 asked on discord: https://discord.com/channels/885562378132000778/1166447479609376850/1207458257874984970 Q: Is there a way to write out a dataframe to parquet with hive-style...
### Is your feature request related to a problem or challenge? @JayjeetAtGithub @Dandandan @yjshen @ozankabak @sunchao and @viirya and submitted a paper to the [SIGMOD 2024 conference](https://2024.sigmod.org), which was tracked...
### Is your feature request related to a problem or challenge? https://docs.databend.com/sql/sql-functions/conditional-functions/ifnull I want implement `IFNULL` function, As implemented by `databend` ### Describe the solution you'd like _No response_ ###...
### Is your feature request related to a problem or challenge? the [`PruningPredicate` ](https://docs.rs/datafusion/latest/datafusion/physical_optimizer/pruning/struct.PruningPredicate.html)currently does not handle `IS NOT NULL` predicates ### Describe the solution you'd like _No response_ ###...
Hmmm...or we should check the result size of udf? I'm not sure wether it's proper that the sizes of input and result could be different. cc @alamb @mingmwang @tustvold _Originally...
### Is your feature request related to a problem or challenge? When I learn `Sort` implementation for #9170 I found now the `fetch` option in ExternalSorter is not used since...
Part of #9171 ## Rationale for this change ## What changes are included in this PR? 1. Add new method `PruningPredicate::row_counts()` to get the total row counts in each container....
## Which issue does this PR close? Closes #9084. ## Rationale for this change Avoid potential exponential explosions in branching calls to `output_partitioning` and `equivalence_properties` in certain plan combinations. ##...
### Is your feature request related to a problem or challenge? We anticipate that DataFusion will become a top-level ASF project, named "Apache DataFusion". Our current logo contains the word...
### Is your feature request related to a problem or challenge? Follow up on #8279 Benefit #9234 ``` query error DataFusion error: Arrow error: Compute error: List\(Field \{ name: "item",...
