siren icon indicating copy to clipboard operation
siren copied to clipboard

SIREN memory requirements

Open pennywise86hw opened this issue 4 years ago • 4 comments

What are the minimal memory requirements for train_wave_equation.py? I am trying to run it on my gpu with 16GB memory, but consistently getting cuda OOM..

pennywise86hw avatar Sep 29 '20 17:09 pennywise86hw

I am also getting the same error tried both 4GB and 16GB GPUs. Any solution?

MahirGulzar avatar Nov 23 '20 17:11 MahirGulzar

Comment out the lines where you the spatial gradients are being computed for visualization. That reduced my memory usage to less than 4GB.

vishwa91 avatar Jan 30 '21 04:01 vishwa91

Could you elaborate more? I couldn't find any lines that were not necessary for the loss computation.

ardywibowo avatar Jun 11 '21 05:06 ardywibowo

I've found it. Simply comment out summary_fn(...) in training.py. Something in write_helmholtz_summary(...) is eating a lot of memory.

ardywibowo avatar Jun 11 '21 06:06 ardywibowo