Multi-GPU instructions

[sgondala]

How do I train the code over multi-GPU setup?

[ruotianluo]

set CUDA_VISIBLE_DEVICES, it will automatically use all the gpus.

[sgondala]

What about the batch size? Should we explicitly increase it (or) would the code automatically take care by multiplying specified batch size by # GPUs?

[ruotianluo]

You have to explicityly increase it. The batch size is the total batch size.