torchdistx
torchdistx copied to clipboard
de-materialize fake tensor/module
Hi I just took a quick look of fake tensor/module APIs. The defer initialization feature looks really cool to me.
I am wondering, is there a way to de-materialize the materialized tensor/module (i.e., step 2 below)?
step 1:
materialize_tensor(tensorA)
step 2:
dematerialize_tensor(tensorA)