torchdistx icon indicating copy to clipboard operation
torchdistx copied to clipboard

de-materialize fake tensor/module

Open GuanhuaWang opened this issue 2 years ago • 0 comments

Hi I just took a quick look of fake tensor/module APIs. The defer initialization feature looks really cool to me.

I am wondering, is there a way to de-materialize the materialized tensor/module (i.e., step 2 below)?

step 1: materialize_tensor(tensorA) step 2: dematerialize_tensor(tensorA)

GuanhuaWang avatar Dec 01 '22 22:12 GuanhuaWang