Low GPU utilization when train on multi-gpus

[smiler96]

there is a problem that much more time-consuming operations is backprogation. while the program performs forwward on mutil-gpus. When i applied this multi-gpus program i find that the gpu utilization rate is really.