composer icon indicating copy to clipboard operation
composer copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

Improving memory snapshot

Open cli99 opened this issue 1 year ago • 0 comments
trafficstars

What does this PR do?

This PR uses _record_memory_history_impl instead of _record_memory_history_legacy (previous) to capture memory snapshot. See https://github.com/pytorch/pytorch/blob/main/torch/cuda/memory.py#L698-L738. With enabled =all, this captures all (c++ and python) alloc/free events and gives better memory timeline and stack trace information.

What issue(s) does this change relate to?

image

cli99 avatar May 23 '24 00:05 cli99