cudf icon indicating copy to clipboard operation
cudf copied to clipboard

[FEA] Expand pinned memory use in libcudf

Open vuule opened this issue 9 months ago • 0 comments

Once https://github.com/rapidsai/cudf/issues/15612 is implemented, libcudf can make further use of the pool to optimize data transfers.

Types like device_scalar can use a small pinned buffer, since pool makes the allocation cost rivial. Also, use of std::vectors as the host mirror of device data (e.g. make_device_uvector_async, make_std_vector_async) can be replaced with a type backed with pinned memory, at least for buffers that are not in the same order of magnitude with the data size.

vuule avatar Apr 30 '24 02:04 vuule