Han Liu

icon location S.t. Louis, U.S. icon location CS Ph.D. from WashU, research in security and privacy of machine learning.

Results 3 issues of Han Liu

OOM when fine-tune the Falcon-7B

5 comment

I tried to fine-tune Falcon-7B on 8 V100 32GB GPU, and I already set the override_max_seq_length = 200, and I tried both 16-mixed and 32-true, both have the OOM error....

Explanation scores using Remove and debias is none

During the reproduction of the blog: [https://jacobgil.github.io/pytorch-gradcam-book/CAM%20Metrics%20And%20Tuning%20Tutorial.html#road-remove-and-debias], I found the scores calculated by cam_metric using remove and debias is always none. I have located the source of the error, the...

gradient computation has been modified by an inplace operation

15 comment

RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.FloatTensor [1, 1, 1, 7]], which is output 0 of AsStridedBackward0, is at version...