datafusion-ballista

datafusion-ballista copied to clipboard

Graceful shutdown: Handle `SIGTERM`

1

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** A clear and concise description of what the problem is. Ex. I'm...

thinkharderdev

Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature

1

# Which issue does this PR close? Closes #259, #6. # Rationale for this change # What changes are included in this PR? # Are there any user-facing changes?

yahoNanJing

**Describe the bug** Due to #134, at the scheduler side, we can not ensure that the execution graph created or there's a job info persisted to the backend after the...

yahoNanJing

CLI uses ballista context instead of datafusion context in local mode

1

# Which issue does this PR close? Closes #219 # Rationale for this change See #219 # What changes are included in this PR? - add concurrent_tasks parameter for ballista...

r4ntix

Make fetch shuffle partition data in parallel

2

# Which issue does this PR close? Closes #208. # Rationale for this change # What changes are included in this PR? # Are there any user-facing changes?

yahoNanJing

**Describe the bug** ``` remziy@remziy-mlt:scheduler$ yarn start yarn run v1.22.19 $ react-scripts start node:internal/modules/cjs/loader:498 throw e; ^ Error [ERR_PACKAGE_PATH_NOT_EXPORTED]: Package subpath './lib/tokenize' is not defined by "exports" in /Users/remziy/FangcloudV2/personal_space.localized/working/Ballista/ballista/ui/scheduler/node_modules/postcss-safe-parser/node_modules/postcss/package.json at...

HaoYang670

Add a feature based object store provider

3

# Which issue does this PR close? Closes #257, #6. # Rationale for this change # What changes are included in this PR? # Are there any user-facing changes?

yahoNanJing

Publish Docker images to Apache repo in DockerHub

2

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** I would like users to be able to download Ballista docker images...

andygrove

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature based on...

yahoNanJing

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Currently ObjectStore cannot be self-registered by its path url, which is very...

yahoNanJing