datafusion
datafusion copied to clipboard
apache
Apache DataFusion SQL Query Engine
Elsewhere in DataFusion (including in `ScalarValue`) we use `ordered_float` to compare floating point numbers It might be possible to use `set::`, which would be more space efficient (fewer bytes than...
Two `$NEGATED` cases look very similar, is it possible to combine them to save code? e.g. ```rust if $CONTAINS_NULL { $ARRAY .iter() .map(|vop| match vop.map(|v| { if $NEGATED { !$VALUES.contains(&v)...
**Describe the bug** currently, each requester can allocate at most `(pool_size - tracker_total) / num_requesters` memory. if an execution plan is skewed there will be a lot of memory wasted...
Currently indexed fields are not supported, causing predicate_evaluation_errors and silently ignoring the predicate. This fix will add support for indexed fields.
# Which issue does this PR close? N/A (at the moment) # Rationale for this change Inspired by @liukun4515 's PR here: https://github.com/apache/arrow-datafusion/pull/2809 I saw some macro use that could...
# Which issue does this PR close? Closes #2785 # Rationale for this change # What changes are included in this PR? # Are there any user-facing changes?
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** As part of the transition to the faster "row format" (#1861 )...
UDTF support (User-defined functions returning table) In my understanding table function returns multiple rows. For now, we have only UDF which returns a scalar value. I don't think it should...
# Which issue does this PR close? https://github.com/apache/arrow-datafusion/issues/2548 # Rationale for this change This PR implements partial support for `ANY` operator, only for `=` & ``. # Are there any...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Currently projection indices are pushed down to scans as `Vec`. This creates...
