datafusion

datafusion copied to clipboard

### Is your feature request related to a problem or challenge? This is a follow on to https://github.com/apache/datafusion/pull/19223 To reduce the scope of that PR, two methods in the Session...

timsaucer

Fix: fix spill oom for sort

1

## Which issue does this PR close? - Closes #. https://github.com/apache/datafusion/issues/19013 ## Rationale for this change When multiple operators attempt to acquire memory from the same memory pool, memory allocation...

xxhZs

## Which issue does this PR close? - Closes #19160 - Part of #19144 ## Rationale for this change ## What changes are included in this PR? - Spark `map_from_arrays`...

kumarUjjawal

## Which issue does this PR close? - Closes #19161 - Part of #19144 ## Rationale for this change ## What changes are included in this PR? - Spark `map_from_entries`...

kumarUjjawal

## Which issue does this PR close? * Closes #18974. ## Rationale for this change The DataFusion CLI currently panics with an "index out of bounds" error when executing queries...

kosiew

fix: spark modulus need to have custom nullability

1

## Which issue does this PR close? - Closes #19165. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are...

JSOD11

Add Substrait roundtrip support for `RecursiveQuery` and recursive CTE scans

1

## Which issue does this PR close? * Closes #16274. ## Rationale for this change Substrait roundtrip mode currently fails for plans that include `RecursiveQuery`, resulting in `not_impl_err!("Unsupported plan type:...

kosiew

Fix flaky SpillPool channel test by synchronizing reader and writer tasks

1

## Which issue does this PR close? * Closes #19058. ## Rationale for this change The `spill_pool` channel test `test_reader_catches_up_to_writer` was flaky due to non-deterministic coordination between the reader and...

kosiew

## Which issue does this PR close? - Closes #19170 ## What changes are included in this PR? - includes custom nullability for `char`.

skushagra

Datafusion crate lacks features to enable object_store's storage options

1

### Is your feature request related to a problem or challenge? Right now, it is not possible to propagated aws/gcp related features to object_store directly from datafusion main crate ###...

DoumanAsh