how to implement multi-gpu for training?

[DavidKong96]

thanks for your sharing. but how can i implement multi-gpu for training？and how to raise batchsize to more than 1? thanks !