pytorch icon indicating copy to clipboard operation
pytorch copied to clipboard

[ROCm] Add support for SymmetricMemory

Open pragupta opened this issue 5 months ago • 2 comments

With the latest IFU into rocm6.3_internal_testing branch, we pulled in SymmetricMemory code which is being used by intra node communication also. SymmetricMemory also introduces a new memory allocator called CUDASymmetricMemoryAllocator. intra_node_comm is now using this new allocator to manage memory.

pragupta avatar Aug 30 '24 03:08 pragupta