Andy Grove
Andy Grove
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Our documentation and scripts are targetted at Mac/Linux and we do not...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** There is no memory management in shuffle writer **Describe the solution you'd...
**Describe the bug** See https://github.com/apache/arrow-ballista/actions/runs/3517937577/jobs/5896585696 **To Reproduce** Steps to reproduce the behavior: **Expected behavior** A clear and concise description of what you expected to happen. **Additional context** Add any other...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** This looks inefficient. We are writing lots of shuffle files, reading them,...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** I would like to be able to monitor scheduler and runtime metrics...
**Is your feature request related to a problem? Please describe.** Spark's `BroadcastHashJoinExec`, `ShuffleHashJoinExec`, and `BroadcastNestedLoopJoinExec` classes implement `outputPartitioning`, but our GPU implementations do not. This could potentially lead to missed...
Part of https://github.com/NVIDIA/spark-rapids/issues/9753 This PR updates GpuCustomShuffleReaderExec to match the logic in Spark, which has changed since we first implemented this. There are three different sets of behaviors: - Spark...
Closes https://github.com/NVIDIA/spark-rapids/issues/10349 We should be able to re-enable this test with a random seed now that https://github.com/NVIDIA/spark-rapids/pull/10542 is merged
**Is your feature request related to a problem? Please describe.** We have a huge list of JSON issues in the [original epic](https://github.com/NVIDIA/spark-rapids/issues/9). This new epic is for tracking the higher...
**Is your feature request related to a problem? Please describe.** I tried running some benchmarks with to_json and from_json and ran into OOM (and split/retry) issues with from_json, even on...