pytorch_memlab icon indicating copy to clipboard operation
pytorch_memlab copied to clipboard

weakly-referenced object no longer exists

Open vsantjr opened this issue 2 years ago • 2 comments

Hello,

Firstly, congratulations for memlab. I have been trying to use it in Google Colab, but sometimes this error happens:

ReferenceError Traceback (most recent call last) in () 33 print('Reporter!!!!!!!') 34 reporter = MemReporter() ---> 35 reporter.report()

2 frames /usr/local/lib/python3.7/dist-packages/pytorch_memlab/mem_reporter.py in (.0) 62 #FIXME: make the grad tensor collected by gc 63 objects = gc.get_objects() ---> 64 tensors = [obj for obj in objects if isinstance(obj, torch.Tensor)] 65 for t in tensors: 66 self.device_mapping[t.device].append(t)

ReferenceError: weakly-referenced object no longer exists

In my code, I use MemReport() just right after the training phase, i.e.:

for epoch in range(num_epochs): net.train() ... # end of training

print('Reporter!!!!!!!') reporter = MemReporter() reporter.report()

Do you know what is the problem?

Thank you and regards.

vsantjr avatar Sep 23 '21 21:09 vsantjr

This error message is weird.

Could you plz post the:

  • memlab version
  • pytorch version
  • the computation devices (GPU type / CPU)

btw could you try adding a torch.cuda.synchronize before creating a reporter.

Stonesjtu avatar Sep 24 '21 00:09 Stonesjtu

Hello,

I am using Google Colab. I just ran !pip install pytorch_memlab in the notebook. The PyTorch version is the one of Colab. The GPU I guess that is K80 but I am not so sure.

Thank you.

vsantjr avatar Sep 24 '21 16:09 vsantjr