loss-landscape-anim
loss-landscape-anim copied to clipboard
[CUDA out of memory] ResNet18 & Cifar100
Hi logancyang, I have successfully run your code using ResNet18 on Cifar100 with bs=16, epochs=200. However, during the 4th epoch, the GPU VRAM overflowed. Upon reviewing the code, I found that this line is causing the GPU RAM to accumulate at each step. Do you have a solution for this problem?
https://github.com/logancyang/loss-landscape-anim/blob/a8d5610ff433b94aca68af42952f0bad8e0e34b3/loss_landscape_anim/model.py#L180
hi @lhchau, thanks for checking this out. This project is not actively maintained at the moment, but feel free to make your own fork if you have time to implement a solution.
I also had the same issue. any solution @lhchau