Vishal Tien

I am having the same issue - even observing an increase in the shape of the tensors that is an exact multiple of the number of GPUs used (like at...

I was able to resolve this error by setting` model.gradient_checkpointing_enable(gradient_checkpointing_kwargs={'use_reentrant': True}) `, as found in https://github.com/Lightning-AI/pytorch-lightning/issues/19267 Still unsure of the root cause but this fixed it for me. Also if...