datafusion-ballista
datafusion-ballista copied to clipboard
apache
Apache Arrow Ballista Distributed Query Engine
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We cannot fix the shuffle mechanism until we have partition stats, or...
**Describe the bug** I can't run the integration tests on an M1 MacBook Air. ``` apache/arrow-datafusion#6 2.909 musl-gcc -I. -Iinclude -fPIC -pthread -m64 -Wa,--noexecstack -Wall -O3 -fPIC -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Once https://github.com/apache/arrow-datafusion/pull/750 is merged, `UnresolvedShuffleExec` and `ShuffleReaderExec` work correctly but they both...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** When the Ballista scheduler or executor deserializes a ParquetExec it collects the...
**Describe the bug** We have a hard-coded `distinct = false` parameter in `ballista/rust/core/src/serde/physical_plan/mod.rs`. ``` rust Ok(create_aggregate_expr( &aggr_function.into(), false, //
# Which issue does this PR close? Closes https://github.com/apache/arrow-ballista/issues/272 # Rationale for this change Trying to improve the user guide # What changes are included in this PR? - Spit...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** When I run SQL benchmarks, I cannot tell from the UI which...
# Which issue does this PR close? N/A # Rationale for this change This is essential to comprehending how Ballista is executing a query.  # What changes are included...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We have a very basic scheduler UI. This issue is for tracking...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** I would like to be able to download query plans in dot...