gpu-bdb icon indicating copy to clipboard operation
gpu-bdb copied to clipboard

Evaluate whether setting host memory limits is still necessary or beneficial

Open randerzander opened this issue 4 years ago • 1 comments

We currently set host memory limits to the max available system memory.

As @beckernick suggests here, the many Dask improvements to GPU memory management may have made the host memory configuration unnecessary. We should evaluate if that's true.

randerzander avatar Jan 20 '21 18:01 randerzander

I agree, we should test this. My expectation is that the net effect of a variety changes makes this primarily relevant for conducting outsized workloads on small infrastructure. Given that isn't likely the default, we likely don't need to default to max system memory.

beckernick avatar Jan 20 '21 19:01 beckernick