DropoutNet icon indicating copy to clipboard operation
DropoutNet copied to clipboard

Allocation of 5224220000 exceeds 10% of system memory.

Open zysNLP opened this issue 5 years ago • 4 comments

When I execute main.py, I get:Allocation of 5224220000 exceeds 10% of system memory. Why?

zysNLP avatar May 16 '19 09:05 zysNLP

I have the same problem, have you solved it?

ninesky110 avatar Jul 13 '21 09:07 ninesky110

image

ninesky110 avatar Jul 13 '21 09:07 ninesky110

when I changed the "data_batch_size" or "max_data_per_step",I got the error. image

ninesky110 avatar Jul 13 '21 09:07 ninesky110

How much RAM do you have on the machine where you are running this code? Also how much GPU memory? In our experiments we saw RAM go up to about 30GB and we used a GPU with 12GB of memory.

@ninesky110 It looks like your loss blew up: https://github.com/layer6ai-labs/DropoutNet/blob/master/main.py#L164-L166. Regarding changing data_batch_size, we recommend using the suggested parameters. If you would like to try different parameters like reduced batch sizes, you may have to tune the hypers a bit.

guangster avatar Feb 09 '22 15:02 guangster