dask-cuda
dask-cuda copied to clipboard
Replace cuDF (de)serializer with cuDF spill-aware (de)serializer
Replace cuDF (de)serializer with cuDF spill-aware (de)serializer, using both together should be avoided as that will cause excessive spilling.
Additionally add:
- Missing test of cuDF internal spill mechanism with
LocalCUDACluster
; -
dask cuda worker
warning to alert the user that cuDF spilling mechanism requires client/scheduler to enable it as well.
Closes #1363 .