cudf
cudf copied to clipboard
[FEA] Expand pinned memory use in libcudf
Once https://github.com/rapidsai/cudf/issues/15612 is implemented, libcudf can make further use of the pool to optimize data transfers.
Types like device_scalar
can use a small pinned buffer, since pool makes the allocation cost rivial. Also, use of std::vector
s as the host mirror of device data (e.g. make_device_uvector_async
, make_std_vector_async
) can be replaced with a type backed with pinned memory, at least for buffers that are not in the same order of magnitude with the data size.