CUDA out of memory

[jeeyung]

Hi, I used 32x32 size images. With 12GB GPUs, I reduce the batch size from 16 to 2 or 1(per gpu).

However, still I got CUDA out of memory error. Could you explain to me how to deal with it?

I used the same hyper parameters that you suggested for CIFAR10.