PyTorch-Encoding icon indicating copy to clipboard operation
PyTorch-Encoding copied to clipboard

CUDA out of memory when training using resneSt200

Open zhouzhengguang opened this issue 5 years ago • 1 comments

Hi, thanks for your work. I use 8GPUs with each 12G memory to train the deeplab using resneSt200 on ADE20K with base-size=512/crop-size=480, however it raises "CUDA out of memory", how do you make it work?

zhouzhengguang avatar Jun 05 '20 08:06 zhouzhengguang

I used Pascal V100 (32 GB) memory GPU to train the model, but I think 16GB should be enough.

For 12GB GPU, you can try using pytorch checkpoint, which is very helpful.

zhanghang1989 avatar Jun 05 '20 15:06 zhanghang1989