functorch icon indicating copy to clipboard operation
functorch copied to clipboard
verified publisher icon pytorch

added list clearing FX codegen for backwards in AOTAutograd.

Open Chillee opened this issue 3 years ago • 2 comments

Chillee avatar May 05 '22 02:05 Chillee

Note: I've currently not bothered to land this PR, as Torchscript seems to keep all of the input activations alive.

We've verified that this reduces memory usage as expected if the graph isn't compiled with Torchscript: https://github.com/albanD/subclass_zoo/pull/41

image

Chillee avatar Jun 29 '22 00:06 Chillee